# cudnn

Published articles for cudnn.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Profiling in PyTorch (Part 3): Attention is all you profile

DevFeed: [Profiling in PyTorch (Part 3): Attention is all you profile](<https://devfeed.tech/articles/profiling-in-pytorch-part-3-attention-is-all-you-profile-7521.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/torch-attention-profile>)

Author: Aritra Roy Gosthipaty; Sergio Paniego; Sayak Paul; Rémi Ouazan Reboul

Published: 2026-07-10T00:00:00Z

Content type: tutorial

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [AI, ML & Data Engineering](<https://devfeed.tech/topics/ai-ml-data-engineering.md>), [jobs](<https://devfeed.tech/topics/jobs.md>), [cpu](<https://devfeed.tech/topics/cpu.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [cudnn](<https://devfeed.tech/tags/cudnn.md>), [flash](<https://devfeed.tech/tags/flash.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [jobs](<https://devfeed.tech/tags/jobs.md>), [kernel](<https://devfeed.tech/tags/kernel.md>), [profile](<https://devfeed.tech/tags/profile.md>), [pytorch](<https://devfeed.tech/tags/pytorch.md>), [torch](<https://devfeed.tech/tags/torch.md>), [traces](<https://devfeed.tech/tags/traces.md>), [xformers](<https://devfeed.tech/tags/xformers.md>)

### AI overview

A PyTorch profiling tutorial examines naive attention, identifying its primitive operations and the CPU and GPU kernels they launch.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Protect your AI workloads from supply chain attacks

DevFeed: [Protect your AI workloads from supply chain attacks](<https://devfeed.tech/articles/protect-your-ai-workloads-from-supply-chain-attacks-13205.md>)

Original publisher: [Read original article](<https://www.chainguard.dev/unchained/protect-your-ai-workloads-from-supply-chain-attacks>)

Published: 2026-01-30T00:00:00Z

Content type: article

Language: en

Sources: [Chainguard: Unchained](<https://devfeed.tech/sources/chainguard-unchained.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Containers](<https://devfeed.tech/topics/containers.md>), [chainguard](<https://devfeed.tech/topics/chainguard.md>), [Vulnerabilities](<https://devfeed.tech/topics/vulnerabilities.md>), [AI Strategy](<https://devfeed.tech/topics/ai-strategy.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Security](<https://devfeed.tech/topics/security.md>), [PyTorch](<https://devfeed.tech/topics/pytorch.md>), [Tensorflow](<https://devfeed.tech/topics/tensorflow.md>), [MLOps](<https://devfeed.tech/topics/mlops.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-containers](<https://devfeed.tech/tags/ai-containers.md>), [chainguard](<https://devfeed.tech/tags/chainguard.md>), [chainguard-containers](<https://devfeed.tech/tags/chainguard-containers.md>), [chainguard-for-ai](<https://devfeed.tech/tags/chainguard-for-ai.md>), [chainguard-libraries](<https://devfeed.tech/tags/chainguard-libraries.md>), [containers](<https://devfeed.tech/tags/containers.md>), [cudnn](<https://devfeed.tech/tags/cudnn.md>), [cves](<https://devfeed.tech/tags/cves.md>), [data-processing](<https://devfeed.tech/tags/data-processing.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [kserve](<https://devfeed.tech/tags/kserve.md>), [legacy](<https://devfeed.tech/tags/legacy.md>), [libraries](<https://devfeed.tech/tags/libraries.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [nemo](<https://devfeed.tech/tags/nemo.md>), [ollama](<https://devfeed.tech/tags/ollama.md>), [python](<https://devfeed.tech/tags/python.md>), [pytorch](<https://devfeed.tech/tags/pytorch.md>), [security](<https://devfeed.tech/tags/security.md>), [security-vulnerabilities](<https://devfeed.tech/tags/security-vulnerabilities.md>), [supply-chain](<https://devfeed.tech/tags/supply-chain.md>), [supply-chain-attacks](<https://devfeed.tech/tags/supply-chain-attacks.md>), [zero-cve-containers](<https://devfeed.tech/tags/zero-cve-containers.md>)

### AI overview

The article discusses security and operational challenges in AI/ML workloads, including complex dependencies, bloated artifacts, infrastructure sprawl, and unremediated CVEs. It presents Chainguard Containers' minimal images for AI workloads as a way to reduce attack surface, storage needs, and deployment overhead, and cites a 50 MB gpu-operator image compared with a 170 MB upstream equivalent.

### Source excerpt

Chainguard secures AI adoption with minimal, zero-CVE containers and source-built libraries that prevent supply chain malware while keeping developers fast.

## What's new in TensorFlow 2.18

DevFeed: [What's new in TensorFlow 2.18](<https://devfeed.tech/articles/what-s-new-in-tensorflow-2-18-7415.md>)

Original publisher: [Read original article](<https://blog.tensorflow.org/2024/10/whats-new-in-tensorflow-218.html>)

Author: TensorFlow Blog (noreply@blogger.com)

Published: 2024-10-28T19:00:00Z

Content type: release

Language: en

Sources: [The TensorFlow Blog](<https://devfeed.tech/sources/the-tensorflow-blog.md>)

Topics: [Tensorflow](<https://devfeed.tech/topics/tensorflow.md>), [releases](<https://devfeed.tech/topics/releases.md>), [LiteRT](<https://devfeed.tech/topics/litert.md>), [NumPy](<https://devfeed.tech/topics/numpy.md>), [CUDA](<https://devfeed.tech/topics/cuda.md>), [cudnn](<https://devfeed.tech/topics/cudnn.md>), [NCCL](<https://devfeed.tech/topics/nccl.md>), [Google](<https://devfeed.tech/topics/google.md>)

Tags: [announcement](<https://devfeed.tech/tags/announcement.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [cudnn](<https://devfeed.tech/tags/cudnn.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [litert](<https://devfeed.tech/tags/litert.md>), [migration](<https://devfeed.tech/tags/migration.md>), [nccl](<https://devfeed.tech/tags/nccl.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-rtx](<https://devfeed.tech/tags/nvidia-rtx.md>), [python](<https://devfeed.tech/tags/python.md>), [release](<https://devfeed.tech/tags/release.md>), [releases](<https://devfeed.tech/tags/releases.md>), [reproducible-builds](<https://devfeed.tech/tags/reproducible-builds.md>), [tensorflow](<https://devfeed.tech/tags/tensorflow.md>), [tensorflow-core](<https://devfeed.tech/tags/tensorflow-core.md>)

### AI overview

TensorFlow 2.18 introduces NumPy 2.0 compatibility updates, transitions TFLite development to the LiteRT repository, and adds hermetic CUDA, cuDNN, and NCCL dependencies for more reproducible source builds. Binary packages add dedicated kernels for compute capability 8.9 GPUs, including NVIDIA RTX 40 series, L4, and L40, while dropping precompiled support for Maxwell GPUs.

### Source excerpt

Posted by the TensorFlow team TensorFlow 2.18 has been released! Highlights of this release (and 2.17) include NumPy 2.0, LiteRT repository, CUDA Update, Hermetic CUDA and more. For the full release notes, please click here. Note: Release updates on the new multi-backend Keras will be published on keras.io, starting with Keras 3.0. For more information, please see https://keras.io/keras_3/. TensorFlow Core NumPy 2.0 The upcoming TensorFlow 2.18 release will include support for NumPy 2.0. While the majority of TensorFlow APIs will function seamlessly with NumPy 2.0, this may break some edge cases of usage, e.g., out-of-boundary conversion errors and numpy scalar representation errors. You can consult the following common solutions. Note that NumPy's type promotion rules have been changed (See NEP 50 for details). This may change the precision at which computations happen, leading either to type errors or to numerical changes to results. Please see the NumPy 2 migration guide. We've updated some TensorFlow tensor APIs to maintain compatibility with NumPy 2.0 while preserving the out-of-boundary conversion behavior in NumPy 1.x. LiteRT Repository We're making some changes to how LiteRT (formerly known as TFLite) is developed. Over the coming months, we'll be gradually transitioning TFLite's codebase to LiteRT. Once the migration is complete, we'll start accepting contributions directly through the LiteRT repository. There will no longer be any binary TFLite releases and developers should switch to LiteRT for the latest updates. Hermetic CUDA If you build TensorFlow from source, Bazel will now download specific versions of CUDA, CUDNN and NCCL distributions, and then use those tools as dependencies in various Bazel targets. This enables more reproducible builds for Google ML projects and supported CUDA versions because the build no longer relies on the locally installed versions. More details are provided here. CUDA Update TensorFlow binary distributions now ship with d

## Build AI-powered applications using OpenLLM and Vultr Cloud GPU

DevFeed: [Build AI-powered applications using OpenLLM and Vultr Cloud GPU](<https://devfeed.tech/articles/build-ai-powered-applications-using-openllm-and-vultr-cloud-gpu-4027.md>)

Original publisher: [Read original article](<https://developer.mozilla.org/en-US/blog/build-ai-powered-apps-openllm-vultr-gpu/>)

Author: vultr

Published: 2023-12-12T00:00:00Z

Content type: tutorial

Language: en

Sources: [MDN Blog](<https://devfeed.tech/sources/mdn-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [API](<https://devfeed.tech/topics/api.md>), [nginx](<https://devfeed.tech/topics/nginx.md>), [SSL](<https://devfeed.tech/topics/ssl.md>), [Security](<https://devfeed.tech/topics/security.md>), [CUDA](<https://devfeed.tech/topics/cuda.md>), [cudnn](<https://devfeed.tech/topics/cudnn.md>), [Python](<https://devfeed.tech/topics/python.md>), [PyTorch](<https://devfeed.tech/topics/pytorch.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [api](<https://devfeed.tech/tags/api.md>), [article](<https://devfeed.tech/tags/article.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [cudnn](<https://devfeed.tech/tags/cudnn.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [guide](<https://devfeed.tech/tags/guide.md>), [large-language-model](<https://devfeed.tech/tags/large-language-model.md>), [nginx](<https://devfeed.tech/tags/nginx.md>), [python](<https://devfeed.tech/tags/python.md>), [pytorch](<https://devfeed.tech/tags/pytorch.md>), [security](<https://devfeed.tech/tags/security.md>), [ssl](<https://devfeed.tech/tags/ssl.md>)

### AI overview

This tutorial explains how to deploy the Falcon 7B model with OpenLLM on a Vultr Cloud GPU server and generate API responses for AI-powered applications. It covers server provisioning, dependency installation, persistent OpenLLM service setup, Nginx reverse-proxy configuration, load balancing, and SSL-based HTTPS security.

### Source excerpt

Learn how to build AI-powered apps using OpenLLM and Vultr Cloud GPU. This guide shows how to generate API responses using a Large Language Model. It also covers instructions for setting up an Nginx server and implementing SSL security.

## Presenting Project Ergo: How to Build an Airplane Detector for Satellite Imagery With Deep Learning

DevFeed: [Presenting Project Ergo: How to Build an Airplane Detector for Satellite Imagery With Deep Learning](<https://devfeed.tech/articles/presenting-project-ergo-how-to-build-an-airplane-detector-for-satellite-imagery-with-deep-learning-41260.md>)

Original publisher: [Read original article](<https://www.evilsocket.net/2018/11/22/Presenting-project-Ergo-how-to-build-an-airplane-detector-for-satellite-imagery-with-Deep-Learning/>)

Author: Simone Margaritelli

Published: 2018-11-22T17:15:50Z

Content type: tutorial

Language: en

Sources: [evilsocket](<https://devfeed.tech/sources/evilsocket.md>)

Topics: [Keras](<https://devfeed.tech/topics/keras.md>), [Tensorflow](<https://devfeed.tech/topics/tensorflow.md>), [Framework](<https://devfeed.tech/topics/framework.md>), [Deep learning](<https://devfeed.tech/topics/deep-learning.md>), [Deep neural networks](<https://devfeed.tech/topics/deep-neural-networks.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Code](<https://devfeed.tech/topics/code.md>), [Development](<https://devfeed.tech/topics/development.md>), [Back end](<https://devfeed.tech/topics/backend.md>), [Python](<https://devfeed.tech/topics/python.md>), [Shell](<https://devfeed.tech/topics/shell.md>)

Tags: [cnn](<https://devfeed.tech/tags/cnn.md>), [code](<https://devfeed.tech/tags/code.md>), [computer-vision](<https://devfeed.tech/tags/computer-vision.md>), [convolutional-neural-networks](<https://devfeed.tech/tags/convolutional-neural-networks.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [cudnn](<https://devfeed.tech/tags/cudnn.md>), [cybersecurity](<https://devfeed.tech/tags/cybersecurity.md>), [deep-learning](<https://devfeed.tech/tags/deep-learning.md>), [deep-neural-networks](<https://devfeed.tech/tags/deep-neural-networks.md>), [dnn](<https://devfeed.tech/tags/dnn.md>), [ergo](<https://devfeed.tech/tags/ergo.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [image-classification](<https://devfeed.tech/tags/image-classification.md>), [keras](<https://devfeed.tech/tags/keras.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [neural-networks](<https://devfeed.tech/tags/neural-networks.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [planes](<https://devfeed.tech/tags/planes.md>), [planes-detector](<https://devfeed.tech/tags/planes-detector.md>), [planesnet](<https://devfeed.tech/tags/planesnet.md>), [project-release](<https://devfeed.tech/tags/project-release.md>), [python](<https://devfeed.tech/tags/python.md>), [shell](<https://devfeed.tech/tags/shell.md>), [tensorflow](<https://devfeed.tech/tags/tensorflow.md>), [tf](<https://devfeed.tech/tags/tf.md>), [train](<https://devfeed.tech/tags/train.md>), [training](<https://devfeed.tech/tags/training.md>), [tutorial](<https://devfeed.tech/tags/tutorial.md>)

### AI overview

The article introduces Project Ergo, an open-source framework and manager for Keras-based machine-learning projects. It demonstrates prototyping, training, and testing a convolutional neural network with the PlanesNet dataset to build an airplane detector for satellite imagery, including CPU and GPU setup considerations.

### Source excerpt

It's been a while that i've been quite intensively playing with Deep Learning both for work related research and personal projects. More specifically, I've been using the Keras framework on top of a TensorFlow backend for all sorts of stuff. From big and complex projects for malware detection, to smaller and simpler experiments about ideas i just wanted to quickly implement and test - it didn't really matter the scope of the project, I always found myself struggling with the same issues: code reuse over tens of crap python and shell scripts, datasets and models that are spread all over my dev and prod servers, no real standard for versioning them, no order, no structure. So a few days ago I started writing what it was initially meant to be just a simple wrapper for the main commands of my training pipelines but quickly became a full-fledged framework and manager for all my Keras based projects. Today I'm pleased to open source and present project Ergo by showcasing an example use-case: we'll prototype, train and test a Convolutional Neural Network on top of the PlanesNet raw dataset in order to build an airplane detector for satellite imagery.

## Most original prize at The 2017 Deep Learning Hackathon

DevFeed: [Most original prize at The 2017 Deep Learning Hackathon](<https://devfeed.tech/articles/most-original-prize-at-the-2017-deep-learning-hackathon-21531.md>)

Original publisher: [Read original article](<http://lifepluslinux.blogspot.com/2017/03/most-original-prize-at-2017-deep.html>)

Author: Suresh Alse (noreply@blogger.com)

Published: 2017-03-29T20:38:00Z

Content type: article

Language: en

Sources: [Life Plus Linux](<https://devfeed.tech/sources/life-plus-linux.md>)

Topics: [Deep learning](<https://devfeed.tech/topics/deep-learning.md>), [Hackathon](<https://devfeed.tech/topics/hackathon.md>), [Development](<https://devfeed.tech/topics/development.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [Google](<https://devfeed.tech/topics/google.md>), [cudnn](<https://devfeed.tech/topics/cudnn.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [cudnn](<https://devfeed.tech/tags/cudnn.md>), [deep-learning](<https://devfeed.tech/tags/deep-learning.md>), [deeplearning](<https://devfeed.tech/tags/deeplearning.md>), [dev](<https://devfeed.tech/tags/dev.md>), [developers](<https://devfeed.tech/tags/developers.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [hackathon](<https://devfeed.tech/tags/hackathon.md>), [ml](<https://devfeed.tech/tags/ml.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>)

### AI overview

The author describes participating in Deepgram's 2017 Deep Learning Hackathon and building Medivh, a tool intended to predict where users might look on a website before deployment by generating heat maps. The project won the Most original prize, which was an Nvidia Titan X Pascal.

### Source excerpt

Although I have worked on several deep learning projects in the past, I still consider myself to be a newbie in deep learning because of all the new things that keep coming up and it is so hard to keep up with all that. So, I decided to take part in "The 2017 Deep Learning Hackathon" by Deepgram to work on something I have been wanting to do for a while now. I built something called Medivh - prophet from Warcraft who has seen the future. The idea was to build a tool for web developers to predict how users are going to see / use the site even before deploying. Basically, it generates heat maps on websites which show where the user might look at. Example: I will write another post with all the technical details. Here is the sneak peak of how it was done. Apart from building that, We got an opportunity to interact with people like Bryan Catanzaro - maker of CUDNN and VP at Nvidia, Jiaji Huangform from Baidu, Jonathan Hseu from Google Brain etc. We also got to interact with people from Deepgram and their caffe like framework called Kur which seems pretty good. I think I'll write a review about Kur after playing around with it for some more time. Also this: Shenanigans at the @DeepgramAI #DLhackathon !! #ai #hackathon pic.twitter.com/ympPZpPWFG -- BEAST Pets (@beastpets) March 26, 2017 This is me presenting before the results. @DeepgramAI #deeplearning #hackathon @GPUComputing @awscloud @googlecloud class activation mapping web dev guidance @Adobe engineering #AI pic.twitter.com/sDD4vrIUAf -- Leo K Tam (@LeoKTam) March 26, 2017 For Medivh, I won the "Most original prize" - Nvidia Titan X pascal. What a beauty!

## Running Tensorflow on AWS GPUs

DevFeed: [Running Tensorflow on AWS GPUs](<https://devfeed.tech/articles/running-tensorflow-on-aws-gpus-21969.md>)

Original publisher: [Read original article](<https://blog.nelhage.com/post/tensorflow-on-aws/>)

Author: Nelson Elhage

Published: 2017-02-26T23:41:27Z

Content type: tutorial

Language: en

Sources: [Nelson Elhage](<https://devfeed.tech/sources/nelson-elhage.md>)

Topics: [Tensorflow](<https://devfeed.tech/topics/tensorflow.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Amazon EC2](<https://devfeed.tech/topics/amazon-ec2.md>), [CUDA](<https://devfeed.tech/topics/cuda.md>), [cudnn](<https://devfeed.tech/topics/cudnn.md>), [Ubuntu](<https://devfeed.tech/topics/ubuntu.md>)

Tags: [aws](<https://devfeed.tech/tags/aws.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [cudnn](<https://devfeed.tech/tags/cudnn.md>), [ec2](<https://devfeed.tech/tags/ec2.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [tensorflow](<https://devfeed.tech/tags/tensorflow.md>), [ubuntu](<https://devfeed.tech/tags/ubuntu.md>)

### AI overview

A tutorial-style post describing how to prepare an Ubuntu Amazon EC2 GPU environment for TensorFlow model training. It covers creating an AMI with NVIDIA drivers, CUDA, cuDNN, and GPU-enabled TensorFlow, along with kernel-driver installation issues.

### Source excerpt

I've been spending some time learning deep learning and tensorflow recently, and as part of that project I wanted to be able to train models using GPUs on EC2. This post contains some notes on what it took to get that working. As many people have commented, the environment setup is often the hardest part of getting a deep learning setup going, so hopefully this will be useful reference to someone.

## Caffe: Brew your first DNN

DevFeed: [Caffe: Brew your first DNN](<https://devfeed.tech/articles/caffe-brew-your-first-dnn-40105.md>)

Original publisher: [Read original article](<https://korbonits.com/blog/2015-07-29-caffe-brew-your-first-dnn/>)

Published: 2015-07-29T11:49:40Z

Content type: tutorial

Language: en

Sources: [Alex Korbonits](<https://devfeed.tech/sources/alex-korbonits.md>)

Topics: [Deep learning](<https://devfeed.tech/topics/deep-learning.md>), [CUDA](<https://devfeed.tech/topics/cuda.md>), [Python](<https://devfeed.tech/topics/python.md>), [cudnn](<https://devfeed.tech/topics/cudnn.md>), [Homebrew](<https://devfeed.tech/topics/homebrew.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Google](<https://devfeed.tech/topics/google.md>)

Tags: [caffe](<https://devfeed.tech/tags/caffe.md>), [code](<https://devfeed.tech/tags/code.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [cudnn](<https://devfeed.tech/tags/cudnn.md>), [deep-learning](<https://devfeed.tech/tags/deep-learning.md>), [dnn](<https://devfeed.tech/tags/dnn.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [guide](<https://devfeed.tech/tags/guide.md>), [homebrew](<https://devfeed.tech/tags/homebrew.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [installation](<https://devfeed.tech/tags/installation.md>)

### AI overview

A hands-on guide to installing and configuring Caffe to build a deep neural network, including prerequisites such as CUDA, cuDNN, Homebrew, Python, NumPy, and an NVIDIA GPU for GPU mode. It also introduces Caffe's Model Zoo and its use for application-focused experimentation.

### Source excerpt

A hands-on guide to Caffe -- how to brew your first deep neural network and run Google Deep Dream.