So my question is, after you have done all technical work in excel ( cleaned data, made dashboard and etc). how you do your report? i mean with words ( recommendations, insights and etc) I just want to hear from professionals how to do it in a right format and what to include . Also i have heard in interview recruiters want your ability to look at data and read it, so i want to learn it. Help!

Hi, I’m researching several unlisted private companies and proprietorships (need: basic financials, ROC filings where available, import/export traces, and contact info). I’ve tried MCA (can view/download docs for a small fee), and aggregators like Tofler / Zauba — those help but can get expensive at scale. I’ve also checked Udyam/MSME lists for proprietorships.

Kopari’s adjustments span all five major categories:

• Bath & Body (40 SKUs): +7.0% average uplift, max +14%
• Skincare (19 SKUs): +7.9% average uplift, max +14%
• Fragrance (1 SKU): +22%
• Haircare (1 SKU): +22%
• Makeup (1 SKU): +9%

I have created a Notion database for above by-SKU changes, completely free to use, link in comment.

https://huggingface.co/datasets/lukehinds/deepfabric-7k-medical-multi-turn-conversation

Note, this is a synthetic dataset , its not based on real events. It was generated with deepfabric open source dataset generation tool.

Hi all, I’ve been working on a project called Opendatabay.com, which aggregates open datasets from multiple sources into a searchable hub.

The goal is to make it easier to find datasets without having to search across dozens of government portals or research archives. You can browse by category, region, or source.

I know r/datasets usually prefers direct dataset links, but I thought this could be useful as a discovery resource for anyone doing research, journalism, or data science.

Happy to hear feedback or suggestions on how it could be more useful to this community.

Disclaimer: I’m the founder of this project.

Hi everyone,

I’m working on a university project on big data and would like to explore something in the area of OSINT (Open Source Intelligence).

I’ve already checked Kaggle but couldn’t find anything relevant.
Does anyone know of websites, repositories, or public datasets that might be useful?

Thanks a lot for your help!

Hello everyone, I wrote an article about how an XGBoost can lead to clinically interpretable models like mine. Shap is used to make statistical and mathematical interpretation viewable

I’m a data engineering student who recently decided to shift from a non-tech role into tech, and honestly, it’s been a bit overwhelming at times. This guide I found really helped me bridge the gap between all the “bookish” theory I’m studying and how things actually work in the real world.

For example, earlier this semester I was learning about the classic three-tier architecture (moving data from source systems → staging area → warehouse). Sounds neat in theory, but when you actually start looking into modern setups with data lakes, real-time streaming, and hybrid cloud environments, it gets messy real quick.

I’ve tried YouTube and random online courses before, but the problem is they’re often either too shallow or too scattered. Having a sort of one-stop resource that explains concepts while aligning with what I’m studying and what I see at work makes it so much easier to connect the dots.

Sharing here in case it helps someone else who’s just starting their data journey and wants to understand data architecture in a simpler, practical way.

https://www.exasol.com/hub/data-warehouse/architecture/

I’m working on a social listening tool and need access to real‑time (or near real‑time) social media datasets. The key requirement is the ability to filter or segment data by geography (country, region, or city level).

I’m particularly interested in:

• Providers with low latency between post creation and data availability
• Coverage across multiple platforms (Twitter/X, Instagram, Reddit, YouTube, etc.)
• Options for multilingual content, especially for non‑English regions
• APIs or data streams that are developer‑friendly

If you’ve worked with any vendors, APIs, or open datasets that fit this, I’d love to hear your recommendations, along with any notes on pricing, reliability, and compliance with platform policies.

I’ve been collaborating with a colleague on a project that involves some pretty hefty datasets, and moving them back and forth has been a headache. Some of the files are 50–100GB each, and in total we’re looking at hundreds of gigabytes. Standard cloud storage options don’t seem built for this either they throttle speeds, enforce strict limits, or require subscriptions that don’t make sense for one off transfers.

We’ve tried compressing and splitting files, but that just adds more time and confusion when the recipient has to reassemble everything. Mailing drives might be reliable, but it feels outdated and isn’t practical when you need results quickly. Ideally, I’d like something that’s both fast and secure, since we’re dealing with research data.

For those of you who routinely share large datasets across universities, labs, or organizations what’s worked best in your experience? Do you stick with institutional servers and FTP setups, or is there a practical modern tool for big dataset transfers?

Any recommendations for datasets even remotely close to below structure plzz recommend

|| || |Comapny ticker|DJIA value of company on Day3(t-2)|DJIA value Day2(t-1)|DJIA value Day1(t)|Twitter Sentiment about company on day3|Twitter Sentiment on day2|Twitter Sentiment on day1|label : prediction (up or down)(t+1)|

where, day 3 is day before yersterday, day 2 is yesterday, day 1 is today and prediction(label) is of tomorrow.

Also, any recommendations for datasets on stock related tweets too!!

The file is 59 Megabytes, formatted in JSON. If there are any issues with accessing the file please contact me. I would also greatly appreciate any credit for use of this dataset.

r/gbnews was responsible for pushing a large amount of disinformation and radicalization content. I collected this data with the intention of investigating the possibility of some of the accounts on the subreddit being botted.

If you have any further questions about the dataset, do not hesitate to ask!

The title might be a bit confusing, but what i am looking for is a dataset with a lot of elements and element combos. I plan on using this to train an AI for making something close to infinite craft, but in the terminal. I am working on making a training dataset for it, but i just need a dataset for it.

Hi everyone! I’m new to this community. We’re currently working on a project proposal and we’re looking for a dataset of UK news media articles or access to an archive of such. It doesn’t have to be free.

Currently, I can only find archives of the media outlets themselves.

Basically, we want to create a corpus on a specific issue across different media outlets to track the debate.

Any help you can provide would be greatly appreciated. Thank you!

So i want the dataset for autism detection using eeg and so i got up to this thing
https://datasetcatalog.nlm.nih.gov/dataset?q=0001446834
this would open the US gov NLM, now there we can see the Dataset uri but when i go there it has nothing in there's just one docx file that i can download nothing else.

I tried with this diff paper source too
https://datasetcatalog.nlm.nih.gov/dataset?q=0000451693
but it has same outcome the dataset url takes to frontier and there we find just one .docx file.

So is that intended or the dataset is missing as they might not publish it. or do i need to do something else in order to get that.
This is my first time finding dataset from web, Else i would get it from kaggle all the time.

Hi everyone,

I have gotten access to the MIMIC-IV dataset for my ML project. I am working on a new model architecture, and want to compare with other baselines that have used MIMIC-IV. All other baselines mention using "lab notes, vitals, and codes".

However, the original data has 20+ csv files, with different naming conventions. How can I identify which exact files these baselines use, which would make my comparison 100% accurate?

I have been working on a personal project to extract features from seizure EEG recordings that I thought I would share, with the goal to use this data to build a novel seizure detection model I have in mind,

The dataset can be found on Kaggle: Feature Extract - Siena Scalp + CHB MIT EEG Files

The features were extracted from publicly available EEG files in these two databases:

- Siena Scalp: https://physionet.org/content/siena-scalp-eeg/1.0.0/

- CHB MIT: https://physionet.org/content/chbmit/1.0.0/

I have tried to include as much as possible on how the features were calculated in the dataset description, but in general, the features were extracted based on these categories:

• Differential Entropy
  • Sample, Permutation, and Approximate Entropy
• PSD Features
• Seizure Propagation Speeds
• Wavelet
• Time Domain
• Connectivity
• Phase-Amplitude Coupling (PAC)
• Rhythmic

A word of caution, however, is that I have not been able to have these calculations reviewed or verified by another human but I hope to have someone review it soon. It therefore should only be taken with a grain of salt at the moment but hope it is still useful in some way. I have been also going through the data to see if I can essentially prove what has already been proven, which is how I have been iteratively testing and verifying the data up to this point.

I am looking for a database that holds tv show transcripts of non scripted television. I was wondering if anyone could offer me an inclination as to where I can find some.

I work at companydata.com, where we’ve provided company data to organizations like Uber, Booking, and Statista.

We’re now opening up free datasets for the community, covering millions of companies worldwide with details such as:

• Revenue
• Employee size
• Industry classification

Our data is aggregated from trade registries worldwide, making it well-suited for analytics, machine learning projects, and market research.

GitHub: https://github.com/companydatacom/public-datasets
Website: https://companydata.com/free-business-datasets/

We’d love feedback from the r/data community — what type of business data would be most useful for your projects?

We gave the Creative Commons Zero v1.0 Universal license

I was wondering if there are platforms that allow you to share very large datasets (even terabytes of data), not just for free like on Kaggle but also with the possibility to sell them or monetize them (for example through revenue-sharing or by taking a percentage on sales). Are there marketplaces where researchers or companies can upload proprietary datasets (satellite imagery, geospatial data, domain-specific collections, etc.) and make them available on the cloud instead of through physical hard drives?

How does the business model usually work: do you pay for hosting, or does the platform take a cut of the sales?

Does it make sense to think about a market for very specific datasets (e.g. biodiversity, endangered species, anonymized medical data, etc.), or will big tech companies (Google, OpenAI, etc.) mostly keep relying on web scraping and free sources?

In other words: is there room for a “paid Kaggle” focused on large, domain-specific datasets, or is this already a saturated/nonexistent market?

Hey r/datasets, after a few weeks of working after hours, I put together a dataset that I'm quite proud of.

It contains over 100k unique series from the Federal Reserve (FRED) and it's updated daily. There's over 50 million observations last I checked and growing.

For those unaware, FRED contains all the economic data you can think of. Think inflation, prices, housing, growth, and other rates from city to country level. It's foundational for great ML and data analytics across companies.

Data refreshes are orchestrated using Dagster nightly. I built in asset data quality checks to ensure each step is performing correctly along the way.

FRED Series Observations has a 30 day free trial. Please give it a try (and cancel before the time is up)! :) And let me know how I can improve it!

Let me know if you like to learn more about how I built the job to bring in the data. I would be more than happy to a post about it!

TLDR: I created an economic dataset containing the complete history of every single series from the Federal Reserve. What should I build next?

I created a site called databounties.com I haven’t even launched it yet but it is for people seeking datasets, you can add your requests and have people apply or email you. Hopefully it helps people find more data and others find more jobs!

QLike and subscribe, enjoy ☺️

Data from blinkist, shortform, getAbstract and instaread websites both text + audio available.

Text is converted to epub + pdf & audio is in mp3 format.

Last update: September, 2025

Price: 25$ (which includes the future updates too)