Nitis Mukhopadhyay 
Introductory Statistical Inference [PDF ebook] 

Introductory Statistical Inference develops the concepts and intricacies of statistical inference. With a review of probability concepts, this book discusses topics such as sufficiency, ancillarity, point estimation, minimum variance estimation, confidence intervals, multiple comparisons, and large-sample inference. It introduces techniques of two-stage sampling, fitting a straight line to data, tests of hypotheses, nonparametric methods, and the bootstrap method. It also features worked examples of statistical principles as well as exercises with hints. This text is suited for courses in probability and statistical inference at the upper-level undergraduate and graduate levels.