If the week before your holiday starts your day off is Monday, and you take 3 weeks holiday, what is your day off the week you go back?
Is the answer Friday?
If when you went back they told you Tuesday was your day off that week, wouldn't you be arguing that while you were on annual leave your days off were Tuesday,Wednesday and Thursday?