Largely rebuilding a platform from scratch after ~5 years of DS on Airflow. Comp is between ~50-70 lakh depending on experience. We're using Metaflow/AWS/Snowflake/Iceberg/SparkSQL/Terraform/projen. DS team mostly in US, Platform team mostly in india. You'd champion Metaflow and our other self-serve MLOps practices for DS. I'd work together closely with you. For the largest seller on Amazon where DS are the star of the show (Pattern).
Lots of variety. All kinds of data. All kinds of ML. All the e-commerce use cases (demand forecasting, marketing, advertising, NLP, operations, ...).
A strong hire would ideally
• have a sense of humour
• have a warm, energetic personality that people want to work with, since you'd own adoption of the platform (as well as design). Good English is obviously key here, too. Lots of pair programming / mentoring DS during US hours.
• have product thinking. The platform is your product, and DS are your customers. It's like a mini-tech startup.
• be passionate about high-quality Python code and the relevant tooling, since you'll need to model good practices for DS (and less senior ppl on our team). Our code quality is in a constant state of entropy, so we need you to push against that.
• have hands-on experience with DS / MLE so you can empathize with DS
• have systems design experience (since DS rely on us to make sure the patterns we provide them for pipelines and endpoints are scalable, cheap, secure, simple, etc.)
• shift your schedule to the late evening since your customers (DS) are offset from IST by 12.5 hours. We typically see ppl start late and work late. It'll be hard to succeed without extensive pair programming with DS.