News & Announcements

RCD Town Hall on March 15th, 2024

The Research Computing and Data (RCD) team plans to hold a town hall event on Friday, March 15th, 2024 from 3-4 p.m. via Zoom. Join us to hear updates about:

  • Palmetto Maintenance (tentatively May 6-May 10)
  • Introducing new RCD Staff
  • All new nodes and owner nodes moving to SLURM in May
  • ZFS File system will be retired this summer
  • Reminder about the upcoming decommission of /scratch1 and /fastscratch this summer
  • Introducing the GLOBUS enterprise license for moving large data sets easily
  • … and more!

Any current student or employee is welcome to participate.  Please register and you will receive a confirmation email containing information about joining the meeting through Zoom.

Update: Did you miss the Town Hall? You can watch the recording or view the slides online.
Note: Users must log in with through Clemson SSO to view these resources, which will be available until April 14th, 2024.

RCDE Announces Spring 2024 Workshop Series

Our spring workshop and training plan has been released and is available on our documentation site.  By popular demand, all our spring workshops will have remote options. Please reach out to us with any suggestions or requests on our training offerings.

New CPU Nodes

We are excited to announce our new CPU buy has been finalized and 65 nodes will be installed in the Slurm Beta cluster.

Each node has:
CPU: 2x AMD EPYC 9654 – 96-core per socket, 192 cores total
Memory: 768GB
Network: 200G NDR200 IB, 25G Ethernet

These nodes will replace our aging C1 nodes.  Phases 3, 4, and 6 will be removed this winter.  Phases 1a, 1b, 5c, 5d will be removed later. There are a total of 9860 cores in C1 right now, and 7044 total will be removed from the C1 cluster in the next several months. Phases 2a, and 2c will remain available. Our new purchase will provide 12480 cores, so we are replacing them at better than 1-to-1 in cores and memory.   In addition, the new nodes will have the latest generation of CPU architecture and we expect a vast improvement over the removed nodes on core for core performance.  Once the nodes are installed, we can provide some benchmarks.

We will provide up to 35 of these nodes for sale to interested faculty members who would like priority access. Please see our purchasing guide for pricing and details.

We expect them to be installed and available in the Slurm Beta cluster early in the spring semester.

Upcoming Maintenance for January 2024

The RCD team has planned a scheduled maintenance window for the Palmetto Cluster between Thursday, January 4th and Sunday, January 7th, 2024. Users should expect the cluster to be unavailable during this time, and any jobs running when maintenance begins will be canceled.

Return to this page for updates on planned work!

RCD Town Hall on December 6th, 2023

The Research Computing and Data (RCD) team plans to hold a town hall event on Wednesday, December 6th, 2023 from 2-3 p.m. via Zoom. Join us to hear updates about:

  • An introduction to new members of the RCD team.
  • An introduction to the new Indigo Data Lake storage system.
  • The upcoming beta period for the new cluster using the SLURM scheduler.
    • Including training opportunities.
  • Our plans for modernizing the hardware in the cluster and improving hardware stability.
  • Reminder about the upcoming decommission of /scratch1 and /fastscratch in Summer 2024.
  • … and more!

Any current student or employee is welcome to participate.

Update: Did you miss the Town Hall? You can watch the recording or view the slides online.
Note: Users must log in with through Clemson SSO to view these resources, which will be available until January 31st, 2024.

New Research Facilitator Joins RCDE

Zachary Gerstner joined the Research Computing and Data, Engagement (RCDE) team as a Research Facilitator on Friday, December 1st, 2023. He will work with the Advanced Computing and Data Services (ACDS) division to assist users with their HPC needs.

New Senior Research and Cloud Computing Facilitator Joins RCDE

Sai Nandigam joined the Cloud and Software Services (CSS) division of the Research Computing and Data, Engagement (RCDE) team as a Senior Research and Cloud Computing Facilitator.

Upcoming Maintenance for Summer 2023

The RCD team has planned a scheduled maintenance window for the Palmetto Cluster between Monday, July 10th and Friday, July 14th, 2023. Users should expect the cluster to be unavailable during this time, and any jobs running when maintenance begins will be canceled.

We’ll be working on:

  • Introducing a new mini-cluster as a test for the SLURM scheduler, which will replace PBS on Palmetto during a future maintenance window.
  • Updating configuration on compute nodes to improve I/O performance to the Indigo data lake.
  • Preparing for the end-of-life for /scratch1 and /fastscratch, which is planned for July of 2024.
  • Upgrading infiniband drivers to improve stability and NVIDIA drivers to support newer versions of CUDA.

RCD Town Hall on June 20th, 2023

The Research Computing and Data (RCD) group held a town hall on Tuesday, June 20, 2023, from 2-3 p.m. via Zoom. We shared with the community that:

  • The condominium model is alive and well. Palmetto will remain available for everyone at Clemson to use at no charge, and faculty can purchase nodes for priority use.
  • We reviewed new services launched by RCD since the last town hall, including our new documentation, GitLab, Mattermost, XDMoD, and our beta Kubernetes service.
  • We have started a new user group, the REDCAT Advisory Body, to help facilitate conversations between faculty and RCD.
  • We covered our progress on the infrastructure refresh announced at the last town hall.
  • We announced the upcoming maintenance period for Palmetto between July 10th and 14th and provided details about what work will be completed.
  • We discussed the future of job scheduling on Palmetto 2 with SLURM and our plans to assist researchers transitioning from PBS.
  • We announced our new Indigo Data Lake storage system backed by VAST with all NVMe flash media and discussed the future of research storage purchases.
  • We let everyone know that our team will be attending the PEARC 23 conference and expect delays in response to support tickets between July 22nd and July 28th.

For more details, please review the slide deck and webinar recording of the town hall (Clemson login required).

New Senior Research Facilitator Joins RCDE

Fanchen Meng, PhD joins the Research Computing and Data, Engagement (RCDE) team as a Senior Research Facilitator.

RCDE Announces Summer 2023 Workshop Series

The RCDE team is excited to announce our Summer 2023 workshop series! We have 12 workshopsplanned, which are offered for free to any interested Clemson University students, faculty, or staff members.

Our series will cover various high-performance computing, machine learning, and software development topics. Here’s a summary of what we’ll cover:

  • Introduction to Linux
  • Introduction to Research Computing on Palmetto
  • Advanced Research Computing on Palmetto
  • Introduction to Python Programming
  • Data Processing and Visualization in Python
  • Introduction to R Programming
  • Introduction to Big Data Analytics using Spark and Python
  • Introduction to Git Version Control with GitLab
  • Machine learning in Python (sklearn)
  • Machine learning in R (caret)
  • Introduction to Deep Learning in PyTorch
  • Advanced Deep Learning in PyTorch

You can learn more about the details of each workshop, the schedule, and registration links on the upcoming live training sessions page of our documentation site.

Register today through our online system to secure your spot!

You may register up to three weeks in advance, but we ask that you cancel your registration if you can’t attend since space is limited. We also encourage you to join us in person for the best interactive experience, but some workshops have virtual attendance options if you need to join us remotely.

New Executive Director for RCD Infrastructure

Scott Groel was named the new Executive Director for Research Computing and Data, Infrastructure (RCDI) on May 1st, 2023. This follows the retirement of Corey Ferrier, who served at Clemson for 25 years, and operated the Palmetto Cluster since its inception in 2008.

New Associate Vice President for RCD

Jill Gemmill, PhD was named the new Associate Vice President for Research Computing and Data (RCD) on April 1st, 2023.

Scratch Storage Update

An issue with the metadata servers caused an outage for /scratch1 and /fastscratch, starting on March 16th, 2023. Our storage architects have worked diligently this afternoon to re-initialize the /scratch1 and /fastscratch file systems.

While working on this issue, we have also brought our new /scratch storage system online. This is a new all-flash storage system that will be the new primary scratch storage space for Palmetto for the forseeable future.

All scratch file systems are now back online and available for use across the cluster.

However, we encourage users to continue using /scratch for their temporary storage needs. We plan to retire /scratch1 and /fastscratch during a future maintenance period, but no definitive retirement date has been set.

New GitLab Service

We have created a new GitLab instance at git.rcd.clemson.edu. This service will help researchers with code storage, version control, continuous integration, and continuous delivery needs.

If you want to learn more and get started, review our GitLab documentation.

RCD Invites Users to Join Our Mattermost Chat Server

We welcome users to our new Mattermost chat server at chat.rcd.clemson.edu. This server operates similarly to Slack and provides a way to collaborate with other researchers to share ideas and best practices. Various channels already exist to help us start the conversation.

If you’d like to join, please follow our Mattermost sign-in instructions on the documentation.

New RCD Documentation

On Mach 8th, 2023, the RCDE team deployed our new documentation site is hosted at docs.rcd.clemson.edu. This site will permanently replace the old documentation at palmetto.clemson.edu.

The new site was developed to make information easier to find and keep the information accurate. We hope you enjoy the modern appearance and vastly improved documentation search.

Palmetto Now Benchmarks at 3 Petaflops!

During the winter maintenance, our infrastructure team ran the HPL linpack benchmark to ensure proper operation of the cluster after the maintenance on compute nodes was performed, and also to verify the hardware stability of compute nodes. The team was able to achieve a score of 3.01 PetaFLOPS during this testing.

Cluster Maintenance for Winter 2022

The RCD team performed scheduled maintenance on the Palmetto Cluster between December 21st and 23rd, 2022. The following changes were made:

  • We have patched and rebooted all compute nodes; firmware has been updated.
  • We have updated firmware and OS versions on all network switches.
  • We have updated BeeGFS.
  • We have installed new optimized versions of OpenMPI and new versions of software that depend on OpenMPI. The old versions were not modified and will remain installed until everyone can migrate to the new optimized versions.

New Nodes Added to Palmetto

Clemson University has funded the purchase of additional compute resources for the Palmetto Cluster. The infrastructure team has added 40 new nodes with 2x 32-core CPUs, 256GB of RAM, and 2x NVIDIA A100 GPUs to the cluster. These resources will be for shared use by the Clemson research community.

RCD Town Hall on December 15, 2022

The Research Computing and Data (RCD) group held a town hall on Thursday, December 15, 2022 from 2-3 p.m via Zoom. We shared with the community our new team structure, new node additions to Palmetto, new flash storage system, and our future goals.

Resulting from the community’s input, we have made the following changes:

  • The units named “CITI” (user support) and “ACI” (infrastructure support) have been eliminated.
  • The newly formed “Research Computing and Data” (RCD) division in CCIT combines RCD Engagement (formerly CITI) and RCD Infrastructure (formerly ACI) into one group to better serve the research community and to streamline operations.
  • RCD Infrastructure (RCDI) is led by Corey Ferrier and is responsible for installing, operating, and maintaining the research computing hardware infrastructure, including the Palmetto HPC cluster and data storage.
  • RCD Engagement (RCDE) is led by Jill Gemmill and is responsible for research computing user support including training, application installation, and one-on-one help with using the research computing facilities. RCDE also includes the Center for Geospatial Technologies.
  • RCD is expanding the Palmetto HPC support team and adding new support services for Cloud Computing, Machine Learning, Data Science, and regulated data such as PHI and CUI.
  • Clemson has invested $6M for a new data lake storage system, new Palmetto nodes, improved hardware for ArcGIS software, specialized machine learning nodes, and systems for secure use and analysis of regulated research data (such as PHI/HIPAA and Controlled Unclassified Information).

For more details, please review the slide deck and webinar recording of the town hall (Clemson login required).