Between is a preposition. In English, a preposition must be followed by an indirect object pronoun.
Me is an indirect object pronoun.
I is a subject pronoun.
Therefore, between must be followed by me, not I
Example:
1. This agreement is only between you and me.
2. I want you to keep this between you and me.