Hey there 👋
I am Ross Carvalho
Software Engineer
Experienced professional specializing in data engineering, cloud technologies and software development, with experience of delivering end-to-end solutions for data platform, data warehousing and ETL pipelines. Designed and implemented cost-efficient, high-performance data platform architectures on AWS and GCP. Accomplishments include automating complex pipelines, optimizing SQL scripts, and developing custom ETL frameworks. Offers a unique blend of technical skills to drive innovation and mentorship within the software development, cloud computing and data engineering field.
Work Experience

Software Development Engineer (Intern) at Apple

From Jun 2024 — Aug 2024 at Cupertino, USA
  • Migrated outdated software services to optimized alternatives, achieving a 40% improvement in performance efficiency.
  • Developed an End-to-End testing framework and comprehensive test suites for Kubernetes using the Go Ginkgo library, resulting in a 12x reduction in error reporting times and enhanced test coverage by 30%.
  • Transitioned static JSON configurations to configurations as code using Apple’s open-source tool, PKL, reducing repetitive configuration tasks by 50% and integrating testing features for enhanced configuration validation.

Software Development Engineer - 1 at FYND (Shopsense Retail Technologies Private Limited)

From Jul 2022 — Aug 2023 at Mumbai, India
  • Designed and implemented architectural solutions for migrating NoSQL data sources (MongoDB) and relational databases (MySQL, PostgreSQL) to their respective data lakes and data warehouses, resulting in a 70% reduction in cloud costs.
  • Automated the creation of Platform resources and Data pipelines using Terraform and Python which reduced the deployment time by 90%.
  • Developed a Node.js microservice which is one of the core component that handles the analytics section of Fynd Platform.
  • Created end-to-end ML Ops Pipeline using Kubeflow Pipeline SDK on GCP Vertex AI which were utilized in ML model training and deployment.
  • Implemented a Python microservice using Sanic framework and Kserve client library which is used by Boltic team for ML model deployment.

Data Engineer at QUANTIPHI

From Aug 2020 — Jun 2022 at Mumbai, India
  • Developed SCD1/SCD2 Facts and dimension SQL scripts for insurance data model which were further used by Analysts to populate Business KPI’s.
  • Collaborated on the development and comprehensive testing of a custom Python ETL framework, delivering enhanced efficiency and scalability compared to IICS pipelines.
  • Automated unit testing by creating a python framework which reduced 50% of team’s workload.
  • Played a key role in identifying and addressing critical issues during UAT for smooth production deployment.
  • Automated IICS pipelines monitoring using AWS Lambda and IICS API’s which helped the support team to patch issues faster.
  • Mentored individuals and took sessions on data engineering, data modeling, cloud engineering and cloud certifications.

Framework Engineer Internship at QUANTIPHI

From Jan 2020 — Aug 2020 at Mumbai, India
  • Trained as a Cloud Data Engineer equipped with skills on AWS, GCP, SQL, Python and Data Warehousing.
  • Engineered backend of a Python-based microservice, which assisted frontend service to communicate with core ML services, utilizing the Flask framework, Docker and GCP services.
On Campus Work Experience

Lab Coordinator Assistant at Computational Intelligence Lab (Pace University)

From Nov 2023 — Present at New York, USA
  • Redesigned and developed a reliable and scalable JupyterHub service on-premise, achieving 99.99% uptime. This scalable solution empowers researchers with seamless access to computational resources, boosting lab efficiency and productivity.
  • Proactively managed daily IT operations, ensuring optimal performance and inventory accuracy for all lab systems and components.
Education

Master’s in Computer Science at Pace University

Sep 2023 - Present at New York, USA
  • GPA : 4.0/4.0

Bachelor’s in Computer Engineering at Mumbai University

Jul 2016 - Jun 2020 at Mumbai, India
  • GPA : 9.55/10
Certifications
Skills
  • C
  • Java
  • Javascript
  • Python
  • SQL
  • Shell Scripting
  • AWS
  • GCP
  • Docker
  • Terraform
  • Jira
  • Microsoft Office
  • Snowflake
  • Git
  • Jira
Publications