PSC Activates Region's First 100-GE Network

Region’s First 100-Gigabit-per-Second Network Opens in Pittsburgh

Pittsburgh Supercomputing Center Brings New Technology to Regional Users

Monday, Dec. 2, 2013

Pittsburgh Supercomputing Center (PSC) has upgraded the Three Rivers Optical Exchange (3ROX) Internet2 connection to 100 gigabits per second (GE, or gigabit Ethernet). The new connection puts 3ROX at the leading edge of academically based networks, offering users speeds 10 times those of the highest-bandwidth academic and industrial connections in the region. The new connection is about 5,000 times faster than typical home broadband Internet.

PSC Receives Four HPCwire Awards

Pittsburgh Supercomputing Center Receives Four HPCwire Awards

Awards Recognize Outstanding Achievements in Science and Technology

Monday, Nov. 18, 2013

Pittsburgh Supercomputing Center (PSC) has received top national honors in four categories of the 2013 HPCwire Readers’ and Editors’ Choice Awards. HPCwire, the trade publication for the high performance computing (HPC) community, announced the winners at the start of the opening reception at the 2013 International Conference for High Performance Computing, Networking, Storage and Analysis (SC13), in Denver, Colorado.

$178,000 Grant for Tool to Spot Network Glitches

$178,000 Grant for Tool to Spot Network Glitches

Web10G Project Will Create User-Friendly “Dashboard” for Identifying, Fixing Data Slowdowns

Tuesday, Oct. 29, 2013

The Web10G Project has received a one-year, $178,000 Software Development for Cyberinfrastructure (SDCI) supplemental award from the National Science Foundation to develop a “dashboard” that will allow users of computer networks to identify when and where a networking problem is slowing or blocking their access. Web10G, funded by an earlier, three-year SDCI grant, is a collaboration between Pittsburgh Supercomputing Center (PSC) and the National Center for Supercomputing Applications.

“We’ve found that a lot of network users either have unrealistically high expectations or unrealistically low expectations for network performance,” says Chris Rapier, PSC network applications engineer. “Web10G has produced 127 different instruments that report on what’s going on with the network connection, ways in which it might be failing and ways in which it might be improved. With the supplemental grant, we’re going to automate that process to let users know what’s reasonable and then help them work with their network operations teams to actually get the performance they need.”


PSC Lands $7.6-Million Data Exacell Grant

Pittsburgh Supercomputing Center Lands $7.6-Million NSF Grant

Four-Year Project to Prototype the Data Exacell, a Next-Generation System for Integrated Data Storage and Analytics

Monday, Oct. 21, 2013

The National Science Foundation (NSF) has approved a grant to Pittsburgh Supercomputing Center (PSC) to develop a prototype Data Exacell (DXC), a next-generation system for storing, handling and analyzing vast amounts of data. The $7.6-million, four-year grant will allow PSC to architect, build, test and refine DXC in collaboration with selected scientific research projects that face unique challenges in working with and analyzing “Big Data.”

MARC Program Helps Prepare Students for 21st-Century Biology Careers

Mind the Gap

MARC Program Helps Minority-Serving Institutions Prepare Students for 21st-Century Biology Careers

August 13, 2013

American biology education risks becoming a two-class system. The top-tier institutions understand that bioinformatics—using advanced computing techniques on biological problemswill soon be a job requirement in much of biology, and have expended considerable resources to create bioinformatics classes, degree programs and research centers. Students at institutions without such resources or expertise, on the other hand, are in danger of being left behind.

CFL Software, PSC Collaborate on Next Generation Search Technology

CFL Software, PSC Collaborate on Next Generation of Information Searching

JULY 18, 2013

SherlockNew software being developed by CFL Software may transform our ability to search for information in text documents as profoundly as search engines improved upon paper library card catalogs. The software, CFL Discover, will search electronic text documents far more completely and accurately than possible with today’s search technologies.

Pittsburgh Supercomputing Center (PSC) is collaborating with CFL as a strategic partner in developing CFL Discover, making the software available to researchers on Sherlock, a modified version of YarcData’s UrikaTM, a real-time data discovery appliance at the center.

“This is a new venture both in terms of scale and speed in searching for information,” says David Woolls, CEO of CFL Software, which specializes in linguistic document forensics. “In essence, we take over where search engines stop.”

While many users may not be aware of it, search engines don’t completely search all the text in the entire Web — that would take far too long. Instead, they search indexes, keywords, categories and other “metadata” that have been added to those documents. In the case of keywords and categories, that addition has to be made by humans, and so is time-intensive and incomplete. Today’s engines obviously revolutionized our ability to find information, but they are inexact. Many irrelevant sites pop up, and many sites that may be more suitable aren’t captured. In a sense, we all stop when we reach a site that is “good enough” rather than one that’s best for our needs.

“Search engines start with a few words and return a list of documents which contain them,” Woolls adds. “CFL Discover starts with one or more of those documents and reads them for you, shows you the terminology that is shared and gives immediate access to the passages of particular interest to you.”

The program uses YarcData’s industry-standard SPARQL query language and RDF (Resource Description Framework) to search entire texts for meaningful connections between the words in a search query and related language in other texts. This kind of “graph search” enables someone searching for information to find relevant connections that they may not have thought of. The program is written in Java, so is platform independent and can work on anything from a standard PC to a Java-capable supercomputer. (While most supercomputers can’t run Java, two at PSC — Sherlock and Blacklight — do, providing valuable support for research communities that primarily use Java for data analytics.) The choice of platform and computer is solely dependent on the volume and speed of response required.

“It’s less like searching for a needle in a haystack than searching for a needle in a needlestack,” says Arvind Parthasarathi, President, YarcData. The advantage of CFL Discover is that it allows related groups of documents to be rapidly identified, not on the basis of pre-determined keywords and categories, but purely on the similarity of the content. This in turn allows the rapid creation of new combined databases from a collection of existing databases. For example, when searching Wikipedia, entering the title of an article causes CFL Discover to read the database, returning a comprehensive list of potentially interesting articles related to the whole content. And because the framework is RDF, searches of other RDF collections can be readily performed. The principles on which the program works allow it to be used in many different languages, including Arabic, Chinese, Thai and Finnish, which appear to be very disparate to the human eye.

“The structures and sequences inherent to individual documents are all that are needed to encode them,” Parthasarathi says. “New material is easily added to existing stores and is immediately available for use by the search queries.”

CFL Software has carried out proof-of-concept studies of CFL Discover to search U.S. Patent Office record and legal document description sections as well as Wikipedia. The collaboration with PSC will employ the program on PSC’s Sherlock, which is optimized to search extremely large and complex bodies of information with open-ended queries. The new work will explore a substantial portion of the U.S. Patent database, in addition to the full data of Wikipedia in more depth.

“PSC’s role in the partnership is to couple the unique analytic capability of Sherlock running CFL Discover with hosting massive datasets on PSC’s Data Supercell to expand text analytics to unprecedented, interdisciplinary use cases,” says Nick Nystrom, PSC’s director of strategic applications. “Response time is critical for exploring big data, and Sherlock with CFL Discover will provide rapid analyses of unstructured text data larger than can be done on any platform currently available to U.S. researchers.”

“We see high value for a wide range of research and societal applications,” Nystrom adds. Examples include analyzing recent events from news and social media sources, extracting deeper insights from sets of publications, and enabling computational history and culturomics — the quantitative study of cultural phenomena by analyzing large volumes of written records. “Application of high-performance analytics is new to these and similar fields, and will catalyze new ways of leveraging unstructured text data.”

Blacklight Research Spurs Change in Stock Exchange Rules

Blacklight Research Spurs Change in Stock Exchange Rules

July 15, 2013

Findings on the effects of “odd lot” trades on the financial markets, using computations on PSC’s Blacklight, have led the New York Stock Exchange, the Nasdaq Stock Market and the Financial Industry Regulatory Authority Inc. to redefine how the industry tracks small stock trades. The new rules will be enacted in October.

Previously, odd lots — trades of 100 or fewer shares — did not have to be reported to regulators. The rationale was that these trades involved small investors who were unlikely to affect the larger market significantly. But recent volatility in the markets, driven by automated small trades that occur far faster than any human can think, called that assumption into question.

In an upcoming paper in The Journal of Finance, Mao Ye, University of Illinois, Urbana-Champaign, Chen Yao of UIUC and Maureen O’Hara, Cornell University, report that odd lots are playing an increasingly important role in the wider behavior of the markets. The researchers used Blacklight and the San Diego Supercomputer Center’s Gordon to analyze market data for the effects of odd-lot trading.

“For every 100 trades of Google, 52 to 53 of them” are in the form of odd lots, Ye observes. “There are more missing trades than trades you can see. In terms of volume, more than 20 percent of the trading volume [among all stocks] is missing” in the official count.

The widely held suspicion is that the largest and most sophisticated traders are using automated trading in odd lots to hide their activities from other traders. In any case, the researchers showed that including the odd lots significantly alters our understanding of the markets. Partly in response to this research, in June 2013 the market authorities agreed to a plan to require all trades, of as few as one share, to be reported.

“In the U.S., they care a lot about the transparency of the market,” Ye explains. The new rule change will remove “a kind of darkness we cannot see and that we never realized was there.”

PSC covered the group’s work in detail in a recent article that you can find here.

Pa. State Budget Includes $500,000 for PSC

2014 Pennsylvania State Budget Includes $500,000 for Pittsburgh Supercomputing Center

July 2, 2013

The Commonwealth of Pennsylvania budget signed by Gov. Tom Corbett on June 30 includes a $500,000 line item for PSC.

“This is very good news for PSC and for the Commonwealth,” says Ralph Roskies, scientific director for PSC, adding that the state’s return on its past investments in PSC has been excellent. “Since our inception we’ve brought over $500 million in outside funds into Pennsylvania, representing a 14:1 return on state funding for PSC.”

“We’re grateful to the members of the General Assembly, and especially the Allegheny County delegation,” Roskies adds. “The bipartisan support of Senators Randy Vulakovich and Jay Costa and Representatives Mark Mustio and Joe Markosek made this possible.”

The funding, says PSC’s leadership, will benefit the state’s technological and workforce infrastructures as well.

“PSC is responsible for generating 1,600 jobs and over $200 million in annual economic activity,” says Cheryl Begandy, PSC’s director of education, outreach, and training. “In addition, our place on the leading edge of computing technologies at the largest scale enables us to respond quickly to technological developments, giving the state, its researchers and its small and mid-sized companies a leg up in capitalizing on these advances.”

The state line item will also prove valuable to PSC’s ongoing competition for federal research funding. Local funding is often seen by granting agencies as concrete evidence of grassroots support for a research center.

“In our fight for federal awards, we’re competing with some of the best high performance computing centers in the world, many of which enjoy significant state funding,” Roskies says. “The state line item will help us retain a competitive edge over and above the excellence of our proposals themselves.”

The details of the line item have yet to be worked out with the state, Roskies says. Potential projects include

  • supporting the Commonwealth’s STEM Education initiative through PSC programs in Computational Reasoning and Bioinformatics
  • collaborating with the Pennsylvania State System of Higher Education to support research and education at its 14 state universities
  • supporting small and mid-sized manufacturers in Pennsylvania through the introduction of Digital Modeling tools, resources and training
  • encouraging workforce development through internships for undergraduate or graduate students
  • continuing PSC core management and outreach efforts expected by federal and other granting agencies

PSC, Numascale AS to Collaborate on Improved Memory Systems for Research

Pittsburgh Supercomputing Center, Numascale AS to Collaborate on Improved Memory Systems for Research

June 28, 2013

Pittsburgh Supercomputing Center (PSC), Pennsylvania’s only National Science Foundation high performance computing facility, and Numascale AS, whose products support the construction of low-cost, scalable-server computer systems, have launched a collaborative project investigating the applicability of Numascale systems to the many research projects requiring more directly addressable memory than is readily available on single, commodity, multi-socket, large memory servers.

“Rapid advancement in many scientific fields of data-dependent research will be facilitated by the availability of larger memory systems at near commodity prices,” says Michael J. Levine, scientific director, PSC. “Having large amounts of data in directly-addressable memory avoids very time-consuming disk input/output and allows a much more productive programming paradigm.”

The field of supercomputing is well known for engineering extreme processing speeds but increasingly, researchers’ calculations are limited not by the speed of processing but access to and efficient use of vast amounts of data. Application areas that require very large memories include natural language processing, multi-organism genomics and quantum chemistry.

“We see the collaboration with Pittsburgh Supercomputing Center as an important milestone for utilizing NumaConnectTM for a number of applications that have previously been limited by inferior memory capacity in standard servers,” says Einar Rustad, CTO and co-founder of Numascale. “The huge and scalable memory capacity in systems with NumaConnect allows users to operate in the familiar programming and runtime environment they are used to with workstations.”

This, Rustad explains, eliminates the need for explicit message passing and significantly reduces the overall time from idea to solution for a number of important applications in many scientific fields. “PSC's unique expertise will strengthen our focus on applications that are key to advances in major scientific fields and help us to widen the market for Numascale.”

The collaboration between PSC and Numascale seeks to leverage PSC’s unique and extensive experience with very large memory computing systems and Numascale’s NumaConnect memory technology to produce systems capable of handling such large data volumes without memory-retrieval lags. NumaConnect uses commodity servers as building blocks to provide memory capacities and retrieval speeds currently only available through high-end and enterprise-class systems. PSC’s application specialists will work with Numascale engineers and application programmers to find ways the two organizations’ experience and expertise can be combined synergistically.

Page 1 of 3

PSC Media Contacts

Media / Press Contact(s):

Kenneth Chiacchia
Pittsburgh Supercomputing Center

Vivian Benton
Pittsburgh Supercomputing Center

Website Contact

Shandra Williams
Pittsburgh Supercomputing Center

Use of PSC materials: To request permission to use PSC materials, please complete this form.

Events Calendar

<<  <  October 2020  >  >>
 Su  Mo  Tu  We  Th  Fr  Sa 
      1  2  3
  4  5  6  7  8  910