The use of words ending in "-ics" is governed by whether you are referring to a single

body of knowledge or to objects/things.

But statistics has something more than this.

These statistics you presented are a pack of lies.

In the first sentence, "statistics" is used in the sense of "the field of statistics" or "the
study of statistics". These are singular concepts. But in the second sentence,
suddenly "statistics" is referring not to a single set of knowledge, but to multiple
pieces of data. A plural verb should be used.

For "mathematics", compare:

The field of mathematics is distinguished by its numerous contributors from across the world
and through time.

The mathematics of quantum physics are hard for the average person to understand.
Generally speaking, if you are referring to a unified whole or a single thing, use the
singular verb form. If you are talking about specific particular objects or subdivisions
of a subject, use the plural form.