Succeeded in data transmission experiment using international R&E networks (total 500Gbps bandwidth) at SC19 Denver, USA
<18 to 21 November 2019>

NICT has exhibited at SC19*1 held in Denver, Colorado, USA from 18 to 21 November 2019. In SC19 exhibition, we constructed a world-scale 500Gbps experimental network (5 x 100Gbps route) which consists of JGN, NICT’s testbed network, and other global R&E networks between Tokyo and Denver for mainly carrying out a demonstration of over-400Gbps data transfer experiment and exhibited the 400Gbps Ethernet interconnectivity demonstration as well as posters illustrating NICT related activities. Our experimental network was also used for demonstrations carried out by universities such as Tokyo University, Osaka University and University of Texas at Dallas (UTD) which collaborated with Keio University.



500Gbps data transfer between Japan and USA using file transfer protocol "MMCFTP" (by NII and NICT)

At the NICT booth, we have conducted data transfer experiments using five 100Gbps routes between Tokyo and Denver by “MMCFTP” (Massively Multi-Connection File Transfer Protocol) developed by NII, and succeeded for achieving the maximum transmission rate over 400Gbps from memory to memory at its peak. The distance and the delay time for each route is significantly different (about 120ms in the shortest path and 360ms in the longest path), consequently the success of this experiment has proved the effectiveness of MMCFTP in the international collaborative use of observational data in the field of the advanced science and technology. Also, this experiment was accepted for SCinet Network Research Exhibition*2 and participated.

For this demonstration experiment, it was required to prepare total 500Gbps bandwidth between Tokyo and Denver. The circuits are connected between Japan and the United States via multiple 100Gbps R&E networks owned by research institutions around the world (Fig. 2). The network must meet the conditions for the experiment such as having necessary bandwidth while making sure that other experiments should not be affected and any routes in the network are not overlapped. On top of this, the experiments like this require traversing multiple network domains. So, it is not only R&E networks to be interconnected internationally, it was essential for us to cooperate closely with international community to customize all sections from end to end whenever necessary.
As a consequence, we have been able to establish total of five 100Gbps routes between Japan and the United States through the Pacific Ocean, Asian and European regions with the cooperation of international community.

The network consisted of;

  • •JGN operated by NICT, SINET operated by NII and WIDE Project’s network in Japan,
  • •the networks of TransPAC project, PacificWAVE and Internet2 in the United States,
  • •SCinet at SC19 venue which operated by the volunteers of network engineers from all over the world,
  • •the network of CANARIE in Canada and
  • •CAE-1*3 owned by AARNet in Australia, GÉANT in Europe, NORDUnet in Northern Europe, SURFnet in
      the Netherlands, TEIN*CC in Korea and SingAREN in Singapore.



Fig.1 Monitoring 5x100Gbps data transfer
Fig.1 Monitoring 5x100Gbps data transfer

Fig.2 Global R&E Networks
Fig.2 Global R&E Networks
zoom

400Gbps Ethernet interconnectivity experiment

In the NICT booth, with cooperation of Juniper Networks, Inc. and Cisco Systems, Inc., we built an experimental interconnectivity environment with 400Gbps Ethernet between their equipment (Fig.3&Fig.4. Juniper QFX5200-32CD and Cisco NEXUS N3K-C3432D-S). 400Gbps Ethernet connections are scarcely used in the world except for large-scale network events. This 400Gbps Ethernet interconnectivity experiment between multiple vendors follows the world’s first successful demonstration experiment of Sapporo Snow Festival ultra-high-definition video transmission by NICT in February 2019.
The two devices were connected with 400G(QSFP-DD) and four out of five paths used in 500G data transfer experiment mentioned above went through the 400Gbps Ethernet in our booth.


Fig.3 400Gbps Network Devices and Servers
Fig.3 400Gbps Network Devices and Servers
zoom
Fig.4 400Gbps Connection
Fig.4 400Gbps Connection


Posters

We exhibited posters below;

  • • NICT Introduction,
  • • NICT’s Integrated Testbed,
  • • NICT’s AI Data Testbed,
  • • Parallel Monitoring Architecture for 100G and Beyond Ethernet (NICT),
  • • 8K ultra-high definition video switcher using software packet switching (Kanagawa Institute of
      Technology and NICT) and
  • • US-Japan experiment of “navigating-as-a-group” in collaborative Augmented Virtuality (AV) tours
      (this experiment is conducted by UTD and Keio University at UTD booth with help from NICT).

International experiments supported by NICT at other SC19 booths

In addition to the demonstration of UTD and Keio university, Tokyo university and Osaka university also conducted experiments at their booths using JGN and international networks. Tokyo university conducted data transfer experiments between file storages with confidentiality and tampering resistance and Osaka university conducted experiments on Data Transfer Nodes (DTN) in collaboration with Northern Western university.

<Photos@SC19>
Fig.5 SC19 Venue
Fig.5 SC19 Venue
Fig.6 SC19 Exhibition Entrance
Fig.6 SC19 Exhibition Entrance
Fig. 7 NICT Booth
Fig. 7 NICT Booth
Fig. 8 SC19 NICT Booth Members
Fig. 8 SC19 NICT Booth Members



Annotation
*1 SC19: SC is the largest conference in the field of High Performance Computing, Networking Storage and Analysis and more than 370 companies and academic institutions exhibited at SC19 which attracted 13,753 people from 118 countries.
[readmore]
*2 Network Research Exhibition: The SC Conference Series is a test bed for cutting-edge developments in high-performance networking, computing, storage, and analysis. Network Research Exhibition (NRE) demonstrations leverage the advanced capabilities of SCinet, SC’s dedicated high-capacity network.
[readmore]
*3 CAE-1: R&E collaboration network connecting Asia and Europe that started its operation in June 2019
[readmore]
National Information and Communications Technology (NICT)
ICT Testbed Coordination and Planning Office
ICT Testbed Research and Development Promotion Center


E-mail: tb-info[at]ml.nict.go.jp