● As a Software Engineer at AIA Labs, I played a key role in designing and developing Data Guardian from scratch—a comprehensive Data Governance platform that enables organizations to manage their data with confidence and control.
● Architected and developed a scalable microservices-based solution for data governance.
● Implemented data discovery and classification features to enable seamless identification and organization of enterprise data.
● Built a policy management and compliance tracking system to ensure data governance aligns with industry regulations.
● Designed and developed integration with Google Cloud Platform (GCP) for fetching data assets, tables, and storage buckets in real-time. Developed the Discovery Module, facilitating Google Cloud Dataform interactions, job creation, and workflow scheduling.
● Developed the Discovery Module, facilitating Google Cloud Dataform interactions, job creation, and workflow scheduling.
● Created the Crawler Module, which retrieves structured and unstructured data across multiple sources.
● Integrated Kafka-based messaging for real-time updates and event-driven data processing.
● Focused on data security, access control, and authentication mechanisms to protect sensitive information.
● Optimized system performance, scalability, and maintainability for enterprise-grade usage.
