Sklearn Boston housing dataset<\/a>to show how the train_test_split method from Sklearn.model_selection can be used to split the dataset into training and test. The test size is specified using the parameter test_size.<\/p>\n#Importing the dataset\nfrom<\/strong> sklearn import<\/strong> datasets\nfrom<\/strong> sklearn.model_selection import<\/strong> train_test_split<\/span>#Then, loading the Boston Dataset\nbhp =<\/strong> datasets.load_boston()<\/span>#Finally, creating the Training and Test Split\nX_train, X_test, y_train, y_test =<\/strong> train_test_split(bhp.data, bhp.target, random_state=<\/strong>42, test_size=<\/strong>0.3)<\/span><\/pre>\nConclusion<\/strong><\/h1>\nIf you have a large dataset, you\u2019re in a hurry, or you\u2019re just starting out with a data science project, you might benefit from the hold-out method. Hold-out methods can also be used to avoid overfitting or underfitting problems in machine learning models. Choosing a classifier is best done using hold-out methods. Additionally, these methods reduce error pruning for trees and facilitate early stopping of neural networks.<\/p>\n
I hope that by now you have a better understanding of what hold-out methods are and how they are used in model selection and model evaluation for training machine learning models.<\/p>\n
Happy Learning!!<\/p>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"
During the evaluation of machine learning (ML) models, the following question might arise: Is this model the best one available from the hypothesis space of the algorithm in terms of generalization error on an unknown\/future data set? What training and testing techniques are used for the model? What model should be selected from the available […]<\/p>\n","protected":false},"author":75,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"customer_name":"","customer_description":"","customer_industry":"","customer_technologies":"","customer_logo":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[6],"tags":[],"coauthors":[172],"class_list":["post-7132","post","type-post","status-publish","format-standard","hentry","category-machine-learning"],"yoast_head":"\n
Understanding Hold-Out Methods for Training Machine Learning Models - Comet<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Understanding Hold-Out Methods for Training Machine Learning Models\" \/>\n<meta property=\"og:description\" content=\"During the evaluation of machine learning (ML) models, the following question might arise: Is this model the best one available from the hypothesis space of the algorithm in terms of generalization error on an unknown\/future data set? What training and testing techniques are used for the model? What model should be selected from the available […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/\" \/>\n<meta property=\"og:site_name\" content=\"Comet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cometdotml\" \/>\n<meta property=\"article:published_time\" content=\"2023-08-14T13:06:29+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-04-24T17:14:46+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/miro.medium.com\/v2\/resize:fit:700\/1*iZpmWiVeFn0bcuMZ_yiEdw.jpeg\" \/>\n<meta name=\"author\" content=\"Kailaash Devi\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Cometml\" \/>\n<meta name=\"twitter:site\" content=\"@Cometml\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Kailaash Devi\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Understanding Hold-Out Methods for Training Machine Learning Models - Comet","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/","og_locale":"en_US","og_type":"article","og_title":"Understanding Hold-Out Methods for Training Machine Learning Models","og_description":"During the evaluation of machine learning (ML) models, the following question might arise: Is this model the best one available from the hypothesis space of the algorithm in terms of generalization error on an unknown\/future data set? What training and testing techniques are used for the model? What model should be selected from the available […]","og_url":"https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/","og_site_name":"Comet","article_publisher":"https:\/\/www.facebook.com\/cometdotml","article_published_time":"2023-08-14T13:06:29+00:00","article_modified_time":"2025-04-24T17:14:46+00:00","og_image":[{"url":"https:\/\/miro.medium.com\/v2\/resize:fit:700\/1*iZpmWiVeFn0bcuMZ_yiEdw.jpeg","type":"","width":"","height":""}],"author":"Kailaash Devi","twitter_card":"summary_large_image","twitter_creator":"@Cometml","twitter_site":"@Cometml","twitter_misc":{"Written by":"Kailaash Devi","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/#article","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/"},"author":{"name":"Kailaash Devi","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/b9c4eafcb9de9b42b30e4a3fe73b7ee4"},"headline":"Understanding Hold-Out Methods for Training Machine Learning Models","datePublished":"2023-08-14T13:06:29+00:00","dateModified":"2025-04-24T17:14:46+00:00","mainEntityOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/"},"wordCount":1106,"publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/#primaryimage"},"thumbnailUrl":"https:\/\/miro.medium.com\/v2\/resize:fit:700\/1*iZpmWiVeFn0bcuMZ_yiEdw.jpeg","articleSection":["Machine Learning"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/","url":"https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/","name":"Understanding Hold-Out Methods for Training Machine Learning Models - Comet","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/#primaryimage"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/#primaryimage"},"thumbnailUrl":"https:\/\/miro.medium.com\/v2\/resize:fit:700\/1*iZpmWiVeFn0bcuMZ_yiEdw.jpeg","datePublished":"2023-08-14T13:06:29+00:00","dateModified":"2025-04-24T17:14:46+00:00","breadcrumb":{"@id":"https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/#primaryimage","url":"https:\/\/miro.medium.com\/v2\/resize:fit:700\/1*iZpmWiVeFn0bcuMZ_yiEdw.jpeg","contentUrl":"https:\/\/miro.medium.com\/v2\/resize:fit:700\/1*iZpmWiVeFn0bcuMZ_yiEdw.jpeg"},{"@type":"BreadcrumbList","@id":"https:\/\/www.comet.com\/site\/blog\/understanding-hold-out-methods-for-training-machine-learning-models\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.comet.com\/site\/"},{"@type":"ListItem","position":2,"name":"Understanding Hold-Out Methods for Training Machine Learning Models"}]},{"@type":"WebSite","@id":"https:\/\/www.comet.com\/site\/#website","url":"https:\/\/www.comet.com\/site\/","name":"Comet","description":"Build Better Models Faster","publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.comet.com\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.comet.com\/site\/#organization","name":"Comet ML, Inc.","alternateName":"Comet","url":"https:\/\/www.comet.com\/site\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","width":310,"height":310,"caption":"Comet ML, Inc."},"image":{"@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/cometdotml","https:\/\/x.com\/Cometml","https:\/\/www.youtube.com\/channel\/UCmN63HKvfXSCS-UwVwmK8Hw"]},{"@type":"Person","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/b9c4eafcb9de9b42b30e4a3fe73b7ee4","name":"Kailaash Devi","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/image\/fe89d54fca6926507ff49e990a4ce6e0","url":"https:\/\/secure.gravatar.com\/avatar\/06b10259af345df1598dc6f786c1500fec0a9665952c3c49aba5563de930b351?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/06b10259af345df1598dc6f786c1500fec0a9665952c3c49aba5563de930b351?s=96&d=mm&r=g","caption":"Kailaash Devi"},"url":"https:\/\/www.comet.com\/site\/blog\/author\/devikailaashgmail-com\/"}]}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/7132","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/users\/75"}],"replies":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/comments?post=7132"}],"version-history":[{"count":1,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/7132\/revisions"}],"predecessor-version":[{"id":15581,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/7132\/revisions\/15581"}],"wp:attachment":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media?parent=7132"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/categories?post=7132"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/tags?post=7132"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/coauthors?post=7132"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
![\"\"](\"https:\/\/miro.medium.com\/v2\/resize:fit:700\/1*iZpmWiVeFn0bcuMZ_yiEdw.jpeg\")
<\/figure>![\"\"](\"https:\/\/miro.medium.com\/v2\/resize:fit:514\/1*yC50uai2UPOcpouXik05Dw.jpeg\")
<\/figure>![\"\"](\"https:\/\/miro.medium.com\/v2\/resize:fit:484\/1*kxySBNHqqBC_CMZY7Zz2sg.jpeg\")
<\/figure>![\"\"](\"https:\/\/miro.medium.com\/v2\/resize:fit:368\/1*YXcAhXtP4vprP_XzMFrpqQ.jpeg\")
<\/figure>![\"\"](\"https:\/\/miro.medium.com\/v2\/resize:fit:550\/1*AejwyUqZ3spg_6N8JLsg6g.jpeg\")
<\/figure>![\"\"](\"https:\/\/miro.medium.com\/v2\/resize:fit:700\/1*TIvUOys2OoCdFOBcDjD9oA.jpeg\")
<\/figure>