• Information For
    • Computational Molecular Sciences Community
    • Environmental System Science Community
    • Exascale Computing Community
    • Scientific Libraries Community
    • Software Engineering Community
    • Supercomputer Facilities and their Users
  • Contribute to BSSw
  • Receive Our Email Digest
  • Contact BSSw
  • Information For
    Computational Molecular Sciences Community Environmental System Science Community Exascale Computing Community Scientific Libraries Community Software Engineering Community Supercomputer Facilities and their Users
  • Contribute to BSSw
  • Receive Our Email Digest
  • Resources

    Better

    Planning

    • Software Process Improvement
    • Software Engineering
    • Requirements
    • Design
    • Software Interoperability
    • Software Sustainability
    • User Experience Design

    Better

    Development

    • Documentation
    • Configuration and Builds
    • Revision Control
    • Release and Deployment
    • Issue Tracking
    • Programming Languages
    • Development Tools
    • Refactoring

    Better

    Performance

    • High-Performance Computing (HPC)
    • Performance at Leadership Computing Facilities
    • Performance Portability
    • Cloud Computing
    • Big Data

    Better

    Reliability

    • Peer Code Review
    • Testing
    • Continuous Integration Testing
    • Reproducibility
    • Debugging

    Better

    Collaboration

    • Projects and Organizations
    • Strategies for More Effective Teams
    • Funding Sources and Programs
    • Software Publishing and Citation
    • Licensing
    • Discussion and Question Sites
    • Conferences and Workshops
    • Research Software Engineers

    Better

    Skills

    • Online Learning
    • In-Person Learning
    • Personal Productivity and Sustainability

    View All Resources

    • Better Planning
    • Better Development
    • Better Performance
    • Better Reliability
    • Better Collaboration
    • Better Skills
    • View All Resources
  • Blog
  • Events
  • About
    • Site Overview
    • Team
    • Policies and Code of Conduct
    • BSSw Fellowship Program
  • Home
  • Resources

Big Data

The analysis of large datasets poses challenges from both hardware and software perspectives. The rise of the use of machine learning and artificial intelligence in science is also fueling the growth in data volumes.
1-6 of 6 Items
Recommended

What Is Big Data?

  Big Data

Applying the FAIR Principles to Computational Workflows

  Reproducibility, Design, Requirements, Big Data

Navigating the Transition of (Climate) Science to the Cloud

  Big Data, Cloud Computing, Online Learning

The Turing Way: Reproducible and Ethical Science

  Reproducibility, Strategies for More Effective Teams, Documentation, Revision Control, Big Data

Webinar: Jupyter and HPC: Current State and Future Roadmap

  Online Learning, Big Data

Webinar: Parallel I/O with HDF5: Overview, Tuning, and New Features

  Online Learning, Big Data

1-6 of 6 Items

Resources by Topic

  • All Planning Resources
  • Software Process Improvement
  • Software Engineering
  • Requirements
  • Design
  • Software Interoperability
  • Software Sustainability
  • User Experience Design

  • All Development Resources
  • Documentation
  • Configuration and Builds
  • Revision Control
  • Release and Deployment
  • Issue Tracking
  • Programming Languages
  • Development Tools
  • Refactoring

  • All Performance Resources
  • High-Performance Computing (HPC)
  • Performance at Leadership Computing Facilities
  • Performance Portability
  • Cloud Computing
  • Big Data

  • All Reliability Resources
  • Peer Code Review
  • Testing
  • Continuous Integration Testing
  • Reproducibility
  • Debugging

  • All Collaboration Resources
  • Projects and Organizations
  • Strategies for More Effective Teams
  • Funding Sources and Programs
  • Software Publishing and Citation
  • Licensing
  • Discussion and Question Sites
  • Conferences and Workshops
  • Research Software Engineers

  • All Skills Resources
  • Online Learning
  • In-Person Learning
  • Personal Productivity and Sustainability
  • View All Resources
logo Better Scientific Software
  • BSSw Fellowship Program
  • Policies
  • Site Contributors
  • Contact BSSw
  • Receive Our Email Digest
  • Follow Our RSS Feed

Copyright © 2025 Better Scientific Software under MIT License

United States Department of Energy Office of Science National Nuclear Security Administration Exascale Computing Project