Can I use this on AWS RDS?
No.
RDS has a strict list of approved extensions. (Since AWS is on the hook for the system stability, security, replication, etc.)
Partially correct, this doesn't work with RDS as you can't install pgsql-http (a requirement for automatic install). However all the extensions listed are "Trusted Language Extensions for PostgreSQL" which was developed by AWS to enable installing extensions written in "Safe" languages. So I believe that all the extensions listed could be installed manually.
https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Postg...