{"id":8412,"date":"2023-12-11T11:05:02","date_gmt":"2023-12-11T19:05:02","guid":{"rendered":"https:\/\/live-cometml.pantheonsite.io\/?p=8412"},"modified":"2025-04-24T17:03:57","modified_gmt":"2025-04-24T17:03:57","slug":"artificial-intelligence-on-mobile-devices","status":"publish","type":"post","link":"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices\/","title":{"rendered":"Artificial Intelligence on Mobile Devices"},"content":{"rendered":"\n
\n
\n
\n
\n
\n
\"iPhone<\/figure>
<\/picture><\/div>\n<\/div>
Photo by Neil Soni<\/a> on Unsplash<\/a><\/figcaption><\/figure>\n

\n<\/p>

The proliferation of machine learning and deep learning algorithms has been ubiquitous and has not left any mobile devices with an ounce of processing power behind, even our smartphones.<\/p>\n

This development can largely be attributed to the increased power that our mobile phones have and a strong desire by consumers to have better features. Hardware has seen a dramatic performance improvement, and software has grown to match these capabilities. Better photographs, recommendation systems, text prediction, and other features have become a staple in even the simplest of modern smartphones. This drives me to ask what challenges existed to deliver this seemingly unreachable dream to us?<\/p>\n

Let\u2019s look at the hardware and software strides necessary to make this leap in progress.<\/p>\n<\/div>\n<\/div>\n<\/div>\n\n\n\n

\n
\n
\n

Deep Learning Architectures and Workarounds<\/h2>\n

Implementing deep learning architectures involves numerous stages, including training data, training the model, inference, and model evaluation.<\/p>\n

The above steps are critical for any deep learning model to succeed, but one quickly hits a constraint wall when you attempt to train these models on hardware found on a smartphone. Trying to train a model on potentially gigabytes or terabytes of data becomes an impossible hill to climb.<\/p>\n

For the above reasons, engineers and developers developed clever workarounds that leverage existing deep learning solutions to the problem. Some of these solutions are commonly used in other domains.<\/p>\n

Efficient Architectures and Pretrained Models<\/h2>\n

One of the most formidable ways to deal with hardware shortcomings is using efficient architectures. These architectures are designed to use smaller processing capacity to be accurate.<\/p>\n

Some of the architectures that fall under this category are MobileNet and ShuffleNet. Howard et al. describe that they \u201cintroduce two simple global hyperparameters that allow the model builder to choose the right sized model for their application based on the constraints of the problem [1].\u201d<\/p>\n

These models make inevitable tradeoffs but can still perform exceedingly well on tasks such as facial recognition, object detection, and other domains on mobile phones.<\/p>\n

We can move on to the next domain, as many of these models are in the common domain.<\/p>\n

Transfer Learning<\/h2>\n

Existing implementations of these models allow developers to deploy them on mobile devices as they deem fit for any given purpose.<\/p>\n

Transfer learning involves using an already-trained model to improve the performance of a new model. Rather than coming up with an implementation that might be inefficient and less capable than is already possible, why not use a proven method?<\/p>\n

APIs such as Keras allow the democratization of these models, and they are even encouraged to be used as they will likely improve the outcome of these efficient architectures.<\/p>\n

Smaller Models for Smaller Machines<\/h2>\n

So far, we might have noticed a pattern that indicates that smaller is preferable for hardware with lower capacity. The above techniques do a phenomenal job of allowing models to perform well. Still, they do not represent the struggle to ensure deep learning models perform optimally on mobile devices.<\/p>\n

Additional integral techniques include pruning, quantization, and distillation, among others. The advent of LLMs has brought some of these techniques, primarily quantization, to the limelight. We\u2019ll dive into these techniques.<\/p>\n

The simplest definition of pruning is that it reduces the parameters in a neural network. It sounds unintuitive but tactfully minimizes the amount of storage a model requires while maintaining good enough performance for a given task (such as image recognition). However, going further than is needed reasonably leads to a reduction in the performance of a model.<\/p>\n

Quantization can be defined as a precision-reducing process that also aims to reduce the amount of memory or storage required for a model. This is done by changing floating point numbers (float data types) to integers (e.g., a float32 to an int8). It uses less memory and has higher efficiency.<\/p>\n

The above is a highly simplified explanation of the standard software techniques in building models for devices with comparably smaller processing power. Fortunately, interventions are not limited to the software domain as robust hardware solutions have steadily risen since the necessity arose.<\/p>\n

Hardware Interventions<\/h2>\n

Phones and other mobile devices have increasingly come to encompass the staples integral to our other computing devices. One of the most important aspects of deep learning is the hardware required to run it. GPUs are essential as their architecture is perfect for running deep learning models.<\/p>\n

GPUs and Neural Processing Units are highly specialized hardware, and they perform the computations necessary in combination with the software mentioned above interventions. Lite versions of deep-learning libraries are also dedicated and optimized to run exclusively on this class of efficient machinery.<\/p>\n<\/div>\n<\/div>\n<\/div>\n\n\n\n

<\/div>\n\n\n\n
\n
\n
\n

Building deep learning models is difficult despite the advances made to make them accessible. Phones and other mobile devices have become more powerful as the need to leverage more processing power for consumer devices has gained traction. For this reason, multiple software, hardware, and even off-machine solutions such as cloud computing have been made a staple.<\/p>\n

Deeper research into these hardware and software interventions will increase the possibilities of phones and other mobile devices.<\/p>\n<\/div>\n<\/div>\n<\/div>\n\n\n\n

\n
\n
\n
Sources<\/h6>\n

[1] Howard, Andrew G., Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. \u201cMobilenets: Efficient convolutional neural networks for mobile vision applications.\u201d arXiv preprint arXiv:1704.04861<\/em> (2017).<\/p>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Photo by Neil Soni on Unsplash The proliferation of machine learning and deep learning algorithms has been ubiquitous and has not left any mobile devices with an ounce of processing power behind, even our smartphones. This development can largely be attributed to the increased power that our mobile phones have and a strong desire by […]<\/p>\n","protected":false},"author":79,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"customer_name":"","customer_description":"","customer_industry":"","customer_technologies":"","customer_logo":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[6],"tags":[],"coauthors":[176],"class_list":["post-8412","post","type-post","status-publish","format-standard","hentry","category-machine-learning"],"yoast_head":"\nArtificial Intelligence on Mobile Devices - Comet<\/title>\n<meta name=\"description\" content=\"The proliferation of ML and deep learning algorithms has not left any mobile devices with an ounce of processing power behind.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Artificial Intelligence on Mobile Devices\" \/>\n<meta property=\"og:description\" content=\"The proliferation of ML and deep learning algorithms has not left any mobile devices with an ounce of processing power behind.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices\" \/>\n<meta property=\"og:site_name\" content=\"Comet\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/cometdotml\" \/>\n<meta property=\"article:published_time\" content=\"2023-12-11T19:05:02+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-04-24T17:03:57+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/miro.medium.com\/v2\/resize:fit:700\/0*KhLkjEd-ebS_jnBw\" \/>\n<meta name=\"author\" content=\"Mwanikii Njagi\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Cometml\" \/>\n<meta name=\"twitter:site\" content=\"@Cometml\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Mwanikii Njagi\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Artificial Intelligence on Mobile Devices - Comet","description":"The proliferation of ML and deep learning algorithms has not left any mobile devices with an ounce of processing power behind.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices","og_locale":"en_US","og_type":"article","og_title":"Artificial Intelligence on Mobile Devices","og_description":"The proliferation of ML and deep learning algorithms has not left any mobile devices with an ounce of processing power behind.","og_url":"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices","og_site_name":"Comet","article_publisher":"https:\/\/www.facebook.com\/cometdotml","article_published_time":"2023-12-11T19:05:02+00:00","article_modified_time":"2025-04-24T17:03:57+00:00","og_image":[{"url":"https:\/\/miro.medium.com\/v2\/resize:fit:700\/0*KhLkjEd-ebS_jnBw","type":"","width":"","height":""}],"author":"Mwanikii Njagi","twitter_card":"summary_large_image","twitter_creator":"@Cometml","twitter_site":"@Cometml","twitter_misc":{"Written by":"Mwanikii Njagi","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices#article","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices\/"},"author":{"name":"Mwanikii Njagi","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/c7043b3e6b992af7b3220aa1f27d2162"},"headline":"Artificial Intelligence on Mobile Devices","datePublished":"2023-12-11T19:05:02+00:00","dateModified":"2025-04-24T17:03:57+00:00","mainEntityOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices\/"},"wordCount":876,"publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices#primaryimage"},"thumbnailUrl":"https:\/\/miro.medium.com\/v2\/resize:fit:700\/0*KhLkjEd-ebS_jnBw","articleSection":["Machine Learning"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices\/","url":"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices","name":"Artificial Intelligence on Mobile Devices - Comet","isPartOf":{"@id":"https:\/\/www.comet.com\/site\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices#primaryimage"},"image":{"@id":"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices#primaryimage"},"thumbnailUrl":"https:\/\/miro.medium.com\/v2\/resize:fit:700\/0*KhLkjEd-ebS_jnBw","datePublished":"2023-12-11T19:05:02+00:00","dateModified":"2025-04-24T17:03:57+00:00","description":"The proliferation of ML and deep learning algorithms has not left any mobile devices with an ounce of processing power behind.","breadcrumb":{"@id":"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices#primaryimage","url":"https:\/\/miro.medium.com\/v2\/resize:fit:700\/0*KhLkjEd-ebS_jnBw","contentUrl":"https:\/\/miro.medium.com\/v2\/resize:fit:700\/0*KhLkjEd-ebS_jnBw"},{"@type":"BreadcrumbList","@id":"https:\/\/www.comet.com\/site\/blog\/artificial-intelligence-on-mobile-devices#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.comet.com\/site\/"},{"@type":"ListItem","position":2,"name":"Artificial Intelligence on Mobile Devices"}]},{"@type":"WebSite","@id":"https:\/\/www.comet.com\/site\/#website","url":"https:\/\/www.comet.com\/site\/","name":"Comet","description":"Build Better Models Faster","publisher":{"@id":"https:\/\/www.comet.com\/site\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.comet.com\/site\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.comet.com\/site\/#organization","name":"Comet ML, Inc.","alternateName":"Comet","url":"https:\/\/www.comet.com\/site\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2025\/01\/logo_comet_square.png","width":310,"height":310,"caption":"Comet ML, Inc."},"image":{"@id":"https:\/\/www.comet.com\/site\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/cometdotml","https:\/\/x.com\/Cometml","https:\/\/www.youtube.com\/channel\/UCmN63HKvfXSCS-UwVwmK8Hw"]},{"@type":"Person","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/c7043b3e6b992af7b3220aa1f27d2162","name":"Mwanikii Njagi","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.comet.com\/site\/#\/schema\/person\/image\/1a3c516cf04aca9418dfb2213081f4df","url":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2023\/08\/cropped-1_2jy9gyk0G_yaniWm8gJFVA-1-96x96.webp","contentUrl":"https:\/\/www.comet.com\/site\/wp-content\/uploads\/2023\/08\/cropped-1_2jy9gyk0G_yaniWm8gJFVA-1-96x96.webp","caption":"Mwanikii Njagi"},"url":"https:\/\/www.comet.com\/site\/blog\/author\/freddynjagigmail-com\/"}]}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/8412","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/users\/79"}],"replies":[{"embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/comments?post=8412"}],"version-history":[{"count":1,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/8412\/revisions"}],"predecessor-version":[{"id":15425,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/posts\/8412\/revisions\/15425"}],"wp:attachment":[{"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/media?parent=8412"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/categories?post=8412"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/tags?post=8412"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.comet.com\/site\/wp-json\/wp\/v2\/coauthors?post=8412"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}