Hello and Welcome from 360DigiTMG. This is a video playlist to explain the life cycle of a data science project. In the previous video we talked about Model Development. Now let us discuss about the next phase in the data science lifecycle – Model Evaluation.
Model Evaluation: This is the penultimate step of the data science life cycle. After the model has been trained, evaluate it to determine if its performance and accuracy will enable you to achieve your business goals. You might want to generate multiple models using different methods and evaluate the effectiveness of each model. For example, you could apply different business rules for each model, and then apply various measures to determine each model's suitability. You also might evaluate whether your model needs to be more sensitive than specific, or more specific than sensitive. For multiclass models, evaluate error rates for each class separately.
You can evaluate your model using historical data (offline evaluation) or live data (online evaluation). In offline evaluation, the trained model is evaluated with a portion of the dataset that has been set aside as a holdout set. This holdout data is never used for model training or validation—it’s only used to evaluate errors in the final model. The holdout data annotations need to have high accuracy for the evaluation to make sense. Allocate additional resources to verify the accuracy of the holdout data.
Best practices for evaluating a model:
• Have a clear understanding of how you measure success
• Evaluate the model metrics against the business expectations for the project
• Plan and execute Production Deployment (Model Deployment and Model
Inference)
That concludes this video. In the final video we will talk about the next phase in the life cycle – Model Deployment and Monitoring.
SUBSCRIBE TO 360DigiTMG’s YOUTUBE CHANNEL NOW
https://www.youtube.com/channel/UCNGIDQ466bNY87eEeKeQuzA
We have specifically created a Facebook Group for all our Data Science aspirants. You can use the below link to join.
In addition to this, we are going to host 2 FREE training sessions Every Single Month on various topics inside this group.
Join FREE Data Science Facebook Group
https://www.facebook.com/groups/DataScience.MachineLearning.ArtificialIntellegence/
CONNECT WITH 360DigiTMG ON SOCIAL MEDIA
Facebook: https://www.facebook.com/360Digitmg/
Linkedin: https://www.linkedin.com/company/360digitmg/
Instagram: https://www.instagram.com/360.digitmg/
YouTube: https://www.youtube.com/channel/UCNGIDQ466bNY87eEeKeQuzA
About 360DigiTMG
360digiTMG is a 5-year-old training & consulting organization led by stalwarts of the industry who are alumnus of premier institutions like the Indian Institute of Technology, Indian Institute of Management and Indian School of Business. 360digiTMG since its inception has been the forerunner in the space of management and niche programs that aid in up-skilling and cross skilling executives across various levels and domains. 360digiTMG has been conducting training programs across the globe for corporate and individuals alike.
360DigiTMG is one stop solution to all the trainings in emerging technologies such as Artificial Intelligence, Machine Learning, Big Data, Project Management, Quality Management, etc. 360DigiTMG is a training company, which is a division of the analytics consulting firm Innodatatics Inc.
For more Information Contact us @::
India : +91 99899 94319
Malaysia: +603 2092 9488
Email: [email protected]
Web: https://360digitmg.com/
Did you find this video helpful? Leave a comment below!
#DataScience #ArtificialIntellegence #Scholarship #DataAnalytics #Jumpstart #360DigiTMG #Malaysia