MySQL “Show table status”, auto increment is not providing next value - mysql

Question

I'm recently installed a new server with a newer MySQL release (from 8.0.13 to 8.0.16) and I have a different behavior while retrieving the next auto increment value of my table.
I was initially using
SHOW TABLE STATUS WHERE `Name` = 'user';
in my previous server it was working perfectly, I was able to retrieve the next auto increment value for the next record, but with the new server the same command is not working properly, the value displayed for auto_increment is not the next one
I have found a post mentioning that it might be due to the cache of the statistics table but on both servers I have
show variables like 'information_schema_stats_expiry';
+---------------------------------+-------+
| Variable_name | Value |
+---------------------------------+-------+
| information_schema_stats_expiry | 86400 |
+---------------------------------+-------+
There is also a solution by disabling the cache of this table by using the command
SET PERSIST information_schema_stats_expiry = 0
but I have two questions:
first: where do I set this information_schema_stats_expiry ? I'm not able to launch this command on a SQL command line, neither in the mysql config file
second: If we disable the cache of this table, is there any issue with the overall database performance ?

Answer 1

I'm not sure why this changed when you upgraded from 8.0.13 to 8.0.16. The documentation says that this variable was added in 8.0.3.
This can be set as a session variable, so you could set it to 0 just in the session that needs to fetch the AUTO_INCREMENT value, and it should bypass the cache. But it won't affect other sessions, so should have minimal overall impact on performance.
SET information_schema_stats_expiry = 0;
SHOW TABLE STATUS WHERE `Name` = 'user';