Prophecy Technologies
Website:
prophecytechs.com
Company:
https://www.linkedin.com/company/prophecytechs
Seniority: Mid-Senior level
Industries: IT Services and IT Consulting
Job details:
- 7 to 10 years of experience
- Building and maintaining data pipelines on Databricks (Spark/PySpark, Delta Lake) that feed into ML workflows
- Feature engineering: preparing and maintaining feature tables used for model training and scoring
- Training ML models and registering/versioning them in Unity Catalog (using MLflow, with UC's catalog.schema.model structure and aliases like champion/challenger for promoting models)
- Running and maintaining scoring pipelines that apply registered models to new data on a schedule
- Monitoring model/data quality over time - tracking drift, validating scoring output, and flagging issues before they hit production
- Working within Unity Catalog for governance across both data tables and ML models
Click on Apply to know more.