Inquiry Response: Service Health Model Monitoring and Effectiveness
We want to get proactive about predicting service health and correcting customer issues. We’re struggling with growing pains when it comes to model monitoring and effectiveness. How have you seen this done?
THE BIG IDEAS:
- Effectiveness monitoring
- Customer pain
- Additional recommendations
To evaluate model effectiveness, select specific reference data points and ensure that they map to specific use cases that you’re targeting. Track standard statistical metrics and also the business logic layer they map to.<