# WWDC 24: Running Mistral 7B with Core ML

DevFeed: [WWDC 24: Running Mistral 7B with Core ML](<https://devfeed.tech/articles/wwdc-24-running-mistral-7b-with-core-ml-7353.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/mistral-coreml>)

Author: Pedro Cuenca; Christopher Fleetwood; Vaibhav Srivastav; Omar Sanseviero

Published: 2024-07-22T00:00:00Z

Content type: tutorial

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Machine Learning & Artificial Intelligence](<https://devfeed.tech/topics/machine-learning-artificial-intelligence.md>), [Swift](<https://devfeed.tech/topics/swift.md>), [swift-transformers](<https://devfeed.tech/topics/swift-transformers.md>), [AI Models](<https://devfeed.tech/topics/ai-models.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [iOS](<https://devfeed.tech/topics/ios.md>), [macOS](<https://devfeed.tech/topics/macos.md>)

Tags: [ai-models](<https://devfeed.tech/tags/ai-models.md>), [apple](<https://devfeed.tech/tags/apple.md>), [coreml](<https://devfeed.tech/tags/coreml.md>), [guide](<https://devfeed.tech/tags/guide.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llm](<https://devfeed.tech/tags/llm.md>), [mistral](<https://devfeed.tech/tags/mistral.md>), [ml](<https://devfeed.tech/tags/ml.md>), [swift](<https://devfeed.tech/tags/swift.md>), [swift-transformers](<https://devfeed.tech/tags/swift-transformers.md>), [wwdc](<https://devfeed.tech/tags/wwdc.md>)

## AI overview

A hands-on guide to running the Mistral 7B language model on Apple Silicon using Core ML and Swift. It covers converting or downloading Core ML models, running inference, and using new Core ML tensor features introduced with iOS 18 and macOS Sequoia, including execution across the CPU, GPU, and Neural Engine.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.