Other Feed Types
  • 11 Jul 2022
  • 5 Minutes to read
  • Dark
    Light
  • PDF

Other Feed Types

  • Dark
    Light
  • PDF

Although ProGet was designed from day one to support multiple types of third-party packages, it wasn’t until ProGet 3.0 that we introduced support for feed types other than NuGet. Since then, we’ve added a whole bunch, and we want to add a whole lot more.

This document will walk through the challenges of new feed types, how we support them, and the progress of requested feed types.

Third-party packages formats are not simple

We’ve learned the hard way that many third-party package managers have an insanely complicated API that’s not only undocumented but requires a significant amount of reverse engineering just understand how it might be implemented in a private repository.

This is not a criticism per se, it just that most of these third-party package managers were designed for community-built, free/open source packages. This use case is totally different than a private repository like ProGet, which requires things like security outside of a basic API key, connectors, replication, license validation, etc.

For us, one of the biggest challenges with these third-party package types is that we lack domain expertise in most third-party package formats. For example, when it comes to developer packages, we are experts on C#/.NET (it’s what we use it to build our tools), so our engineers are going to be intimately familiar with all of the intricacies and complexities of NuGet. We definitely don’t have that expertise in Java, Python, R, Perl, Rust, Ada, COBOL, or 99% of programming languages. That makes it pretty tough to learn the package managers those languages use.

Supporting a new package format means we need to learn how these packages are used, learn the tools in the ecosystem, reverse engineer the package format, figure out the usage conventions, reverse engineer the APIs, etc., before we can even assess how long it might take to engineer an architecture.

Partnering with our users

Given the complexity with just understanding the basics of a third-party package format, we’ve found the best way to implement new feed types is by partnering with our users. They tend to be much more familiar with these package formats than we are, so they can tell us how to use them, point us to conventions, help us discover the internals, and eventually try a proof-of-concept. That last part (trying it out) is really important, because we don’t want to release a feed type that doesn’t work… and we just don’t know how to test it in real-world scenarios.

Without a user partnership, getting a new feed type supported is challenging. As such, this page will largely serve as the place where we discuss the status of various third-party feed types that have been requested.

Status of new third-party feed types

You’re welcome to submit pull requests to this page or contribute to the linked Q&A discussions if you have more information.

✔ Helm: Completed!

Helm Feeds are available as of ProGet 5.2.

✔ Conda (Anaconda) Packages: Completed

Conda Feeds are available as of ProGet v6.0.6!

⌛ R and CRAN: Ready for development, once we find user partners

We've done our initial research, and have a pretty good idea of how to develop this now. But need your help to make sure it's done right. Please join the discussion at QA#2686 to learn more and help us develop this feed type!

📈 Terraform: some recent demand

We've had some interest in Terraform Private Registries, and the discussion is ongoing in the community forums. Please add to QA#3570 to share your thoughts!

📉 Dart/Flutter/pub.dev: some demand

We've had some interest in Dart/Flutter/pub.dev packages, and the discussion is ongoing in the community forums. Please add to QA#3197 on the forums to share your thoughts!

📉 WinGet: very limited demand

This is brand new from Microsoft, so there's not much demand for private feeds - but there is a discusson on the forums, so please contribute if you're interested.

📉 Rust Cargo: very limited demand

We don't really know anything about this format, but we're eager to learn! This is currently in discussion on the forums, so please contribute to the discussion if you have interest!

📉Vagrant: very limited demand

We've had three feature requests for Vagrant over the years, but they were fairly casual inquiries and we didn't get any more info from those users. Our general feeling is that Vagrant is kind of on the outs, and containers are probably going to replace it. Hard to say. Share your thoughts by starting a thread in our forums, and we'll link it here.

📉 Conan (C++): very limited demand

This is currently in discussion on the forums; it's a relatively new package format, and the use cases or popularity isn't very clear. NuGet is already quite popular for C++ packages in Visual Studio, and Universal Packages are used quite frequently for in-house C++ libraries.

📉 Chef Cookbooks: very limited demand

We've had one request for Chef cookbooks (with connectors to the Chef Supermarket) to date, but we know nothing about the underlying format. Interested? Share your thoughts by starting a thread in our forums, and we'll link it here.

📉 Elixir Hex: very limited demand

We've had one request for Elixir Hex packages to date, but we know nothing about Elixir, Hex, or the underlying format. Happy to learn though! Interested? Share your thoughts by starting a thread in our forums, and we'll link it here.

❓ PHP Composer/Packagist: Evaluated, seems really tough

We did a pretty deep dive into PHP/Composer packages a while back, and our conclusion was that they were very difficult to implement due to the way the tightly integrate with git repositories.

However, we did this assessment without any user partners, and we know next to nothing about PHP, so it could be we misunderstood or looked at the wrong things. Maybe not everyone uses the tight git-repository integration? Hard to say. This is why we partner with customers now.

Since then, there haven’t been too many requests for it, and we have no idea what the level of interest is for. Please add to QA#2690 if you've got some insight.

🚫 CocoaPods: no actual interest

We've had one customer ask about this as a feature request; after some back-and-forths it turns out that one of the customer's development teams said "they might consider a private package manager", but didn't really care one ay or another.

🔎Go: package manager not found

We've had a few requests for these, but there doesn't seem to be a package management API. Behind the scenes, Go seems to use GitHub repositories as "packages", and if you want to privatize them, then you proxy github.org. We're not Go developers, so we could be wrong - let us know!

A few of our users simply use universal packages for Go libraries.

Other types?

These are the third-party that we know about, but there are certainly more. Just let us know by posting something in our forums; we can link to it from this page, and track it fairly easily then.


Was this article helpful?

What's Next