When I set DEBUG=False, my 404.html doesn't appear

I put my 404.html into root of the directory specified in TEMPLATE_DIRS. However, when I visit an inexisting page, the browser's 404.html appears rather than my own 404.html page.

What's wrong with me ?

PS: I've set the DEBUG variable in settings.py to False.

 

---

Dae James