A comprehensive evaluation of large language models on Bengali NLP tasks, examining both the potentials and pitfalls of applying LLMs to a low-resource language like Bengali.