I suspect that grinding out the rivets so you can get the epoxy spread is more complex than taking off the top to get at both ends of the rivets, and more likely to cause damage. If you have a couple of large nails, a hammer and a file, you can easily make a punch and anvil setup to compress the rivets.
If the shoe is very loose, there is a zero work fix you might try. Pry up the rear of the shoe as much as you can, and try to get some Crazy Glue into the crack under it. Spread it around under the shoe with a piece of paper, then press the shoe down hard for at least a minute. This glue has the interesting property that it will stay liquid for a very long time unless it is under pressure, whereupon it hardens in less than a minute.
The story is that this stuff was invented to glue people back together in mortuaries. I have no idea if that is true, but it REALLY likes to stick skin to just about anything, so wipe off all the excess carefully before applying any pressure.
Cheers,
Dez