We use custom database tables and our custom PHP API for listings as well since 2012. It would be almost impossible to scale a Directory (especially with many custom fields) using the default WP database architecture. EDD recently made similar changes. I'm glad to see this coming from WooCommerce/Automattic, because it confirms that we made the right choice from the beginning.