XGBoost (eXtreme Gradient Boosting) is a scalable, high-performance library for gradient boosting. It introduces optimizations like tree pruning, parallelization, and regularization. XGBoost has won numerous ML competitions due to its speed and predictive power.