ProjectsDeveloper platforms
Google Cloud modernization proof of concept
Showed a petabyte-scale, on-prem payments data platform could move to Google Cloud, including JanusGraph running on Bigtable.
- Year
- 2025
- Area
- Developer platforms
- Built with
- Bigtable, Dataflow, Dataproc, Cloud Storage, Elastic Cloud, JanusGraph
At Crédit Agricole I worked on backend payment systems built on Spark, Hadoop, HBase, Elasticsearch and JanusGraph, processing petabytes of data. This proof of concept tested whether that platform could run on Google Cloud.
What moved where
| On-prem | Google Cloud |
|---|---|
| HBase tables | Bigtable, via Dataflow pipelines |
| Spark jobs | Dataproc |
| Data lake | Cloud Storage |
| Elasticsearch | Elastic Cloud |
| JanusGraph | JanusGraph on Bigtable |
The hard part
JanusGraph had no official Bigtable support. I traced the incompatibility through its codebase, worked with the upstream maintainer, and wrote an abstraction layer that made it work.
This was a proof of concept, not a full production migration.