Alation
|Software Engineer III
Summary
Data Catalog and Governance: Contributed to building and maintaining a data catalog for managing metadata from various sources (RDBMS, ELT tools like Fivetran/dbt). The catalog enables users to search, sample, and analyze data across the enterprise.
Highlights
Developed connectors for extracting and integrating metadata.
Automated metadata ingestion pipelines for seamless access and analysis.
Supported data governance by integrating data lineage and ensuring regulatory compliance.
Presented Pointed of view using Gen-AI and LLM models to reduce the support case count with actionable hint to customer for Connector framework.
Designed and implemented the Unify Tagging Framework, enabling consistent tag management across multiple data sources for improved metadata governance and search ability.
Documented connector processes, metadata schema, and troubleshooting guides.
Technologies: Python, GenAi, Aws Bedrock, LLM, Java, Docker, Scala, React, gRPC