A millennium equals 1000 years, we calculate the beginning of each millennium the same way we do in centuries, so for example the 3rd millennium BCE includes all of the dates between January 1, 2001 BCE and December 31, 3000 BCE.
I hope this is even a little helpful, I had a hard time with this one.