Pulsar Instruments

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.

====== The PSRIX Instrument ====== ==== Introduction ==== PSRIX was developed in the context of the [[http://www.leap.eu.org | LEAP project]] and is operational since January 2011. Since LEAP needs raw voltages from the participating telescopes, the instrument supported baseband mode since its inception. With the release of multithreaded DSPSR and the availability of multicore CPUs, realtime coherent dedispersion became possible as well. ==== System outline ==== {{ :pulsarinstruments:psrix:psrix-blockdia.png?250| The PSRIX system in blocks }} The system consists of three main parts - two ROACH1 boards, a 10GbE switch and a few high performance computers. The ROACH boards are equipped with a dual-channel 1GSPS analoge-to-digital converter (called iADC), a programmable device (Xilinx Virtex 5 FPGA) and a modest CPU (PowerPC) running the Linux operating system. The iADC samples both polarisations of the astronomical signal using 8-bits and at a programmable rate. On the Virtex 5 FPGA, the signal is digitised and may or may not be (depending on the observer requirement) split in to sub-bands. The polyphase filter bank technique is used not he FPGAs to create sub-bands if needed. The data are then output as UDP packets tagged by an unique IP/port combination. The switch then streams the data to one or few nodes, where the actual data is handled as defined by the PSRIX operational mode. The image on the right shows various parts of the PSRIX system. The two PSRIX ROACH1 boards can be run in parallel to realise timing and baseband modes simultaneously. The second ROACH board can be configured to send out data without the subbands, allowing 1ns time resolution. The high speed data is then routed via the 40Gb switch and captured by the paf0/paf1 nodes. These nodes have access to the high performance beegfs filesystem, which can sustain 4GB/s transfer rates. As shown, the system can process a maximum of 500MHz, depending on the receiver. For the large bandwidth secondary focus receivers (eg, S45, S20 etc.), only the 500MHz band allowed by the MultiFiba is processed by the ROACH boards. === The ROACH boards === {{ :pulsarinstruments:psrix:roach1_cropped.png?300| An image of the ROACH1 board }} There are three combinations of gateware/clock for the ROACH boards. *16 channel, 16 IP version running at 800MHz for pulsar timing *32 channel, 32 IP version clocked at 1024 MHz for LEAP mode *32 channel, 32 IP firmware clock at 1000 MHz for receivers using 750 MHz IF and pulsar search modes. ^ Mode |Firmware| clock (MHz) | subband/bandwidth (MHz)| | Timing |16c16i1024s| 800 |25/200| | LEAP |32c32i1024s| 1024 |16/128| | FilerBank |32c32i1024s|1000|15.625/500| Realtime coherent dedispersion/folding and/or baseband recording is possible in all of the three settings. Depending on the type of observations, various sections of the cluster are active. ===10gbE switch=== HP5412zl serves to connect the ROACH units and the computer cluster. With the recent firmware upgrade the backplane is capable of 768Gpbs throughput. Since the ROACH boards pack data in 8202-byte UDP packet, jumbo frame support is essential both in the switch and the receiving computer. === The computer cluster === The cluster of computers associated with the PSRIX instrument consists of three different sub-clusters. **The automatix nodes**: these are 16 nodes, each with a 2x 16-core AMD CPU. These are dense computing units with 4x nodes in a 2U rack space. These nodes are use for realtime coherent dedispersion and folding of pulsar data. Additionally a software based filter bank is also possible. Recording the sub-bands is the third possibility. **Codeix blade system**: The unit consists of 8x high performance blades and used as a stand-by for the automatix timing mode. Please click the links below for detailed information - [[pulsarinstruments:psrix:modes|Instrument modes]] == Old information == - [[pulsarinstruments:psrix:overview_old|OLD Overview of the instrument]] ----