Site map rus
AboutNews
ActivitiesComputing & Information resources
     Computing & Information resources > CICC     
News
CICC
Registration
Statistics
AFS File System (ps)
dCache Manual
Safety in Network
Libraries
About Parallel Applications
User's Guide
Practical Recommendations
Contact
Photogallery
Old version of CICC site
Architecture and equipment of CICC

Now the structure of the CICC computing farm comprises the following computing machines:

- 60 64-bit machines:
2 processors Xeon 5150 (2 cores per processor);
Clock frequency 2.66GHz;
4096KB cash per core;
8GB RAM;
160GB disk on 20 machines and 250 GB on 40;
1Gb Ethernet.

- 30 64-bit machines:
2 processors Xeon E5430 (4 cores per processor);
Clock frequency 2.66GHz;
6144KB cash per core;
16GB RAM;
250GB Disk;
1Gb Ethernet.

- 10 64-bit machines:
2 processors X5450 (4 cores per processor);
Clock frequency 3.00GHz;
6144KB cash per core;
16GB RAM;
250GB Disk;
1Gb Ethernet;
2x infiniband.

- 10 64-bit machines:
2 processors Xeon E5410 (4 cores per processor);
Clock frequency 2.33GHz;
6144KB cash per core;
16GB RAM;
2 * 160GB Disk;
1Gb Ethernet;
2x infiniband.

- 54 64-bit machines, 2 machines in one case of 2 inches height (U2):
2 processors Xeon E5420 (4 cores per processor);
Clock frequency 2.50GHz;
6144KB cash per core;
16GB RAM;
250GB Disk;
1Gb Ethernet.

- 4 64-bit machines, in one case of 4 inches height (U4):
2 processors Xeon E5540 (4 cores per processor);
Clock frequency 2.536GHz;
8192KB cash per core;
24GB RAM;
250GB Disk;
1Gb Ethernet.

Since 2- and 4-core processors are in fact two and four independent processors on one crystal, we have 1104 64-bit CPU. All these CPU are accessible both to JINR users and Grid users through the unified system of batch job processing - batch.

For the development of home software and other needs of JINR users, installed were 5 machines with interactive access of users:
- 2 x 64-bit machines
Core 2 Duo, 4GB RAM, 120GB + 250GB HDD, 1Gb Ethernet;
- 2 x 32-bit machines
Dual Athlon 2400 +, 2GB RAM, 40GB +120GB HDD, 1Gb Ethernet;
- 1 x 64-bit machine
Xeon E5420, 8 x Core, 16GB RAM, 250GB HDD, 1Gb Ethernet.

The CICC structure includes several servers of support of user work and JINR Services: batch, WWW, DB mysql and Oracle; e-mail; DNS and others. These servers continue working on various hardware platforms from 32-bit Pentium-3, up to 64-bit Xeon and Opteron.

The main system of storing great volumes of information in the JINR CICC is the hardware-software complex dCache. At the moment it includes:
- 12 servers of basic interfaces of the system dCache;
- 32 systems of data storage (Pool).

Some users associations of our center use the system of access to remote information XROOTD. For the work of this system, a hardware-software complex has been created which comprises
- 1 server of processing inquiries to the system;
- 9 systems of data storage.

Hardware platforms of data storage - Intel Xeon, AMD Opteron. All the storage systems are designed with the use of hardware mechanism RAID6. The general accessible capacity of the system is ~800TB.

The JINR CICC has got 6 AFS servers that is a highly protected, distributed file system which is a basis of support of domestic directories of users and a system of access to the general software for the whole Institute. The common space of AFS in JINR is ~3.56TB

In order to serve the site wLCG at JINR (the site is a separate cluster in the distributed system wLCG and EGEE), 24 servers with the system gLite have been installed (software EGEE/wLCG). In addition to functions of support of the operation of site JINR-LCG2, part of the servers realize the important services and functions of support of the Russian segment of the Projects LCG and EGEE.

In order to improve the work of the CICC local area network and achieve the required parameters of access to data and files, aggregation (TRUNK) of several connections 1 Gb Ethernet in the unified virtual channel of increased throughput is applied.

Figure 1 gives a logic structure of the network connection of basket Superblade with 10 computing blades to the CICC local area network.
Figure 2 shows the connection of 20 computing machines installed in the rack to the CICC local area network.
Figure 3 shows the logics of connecting the rack with 8 disk servers to the basic router of the CICC local network.



Fig.1


Fig.2


Fig.3
Using the Scheme of aggregation of network links, we were able to fulfill the requirements on the access speed to data from the computing tasks of the main users of our resources of both the local JINR users and the users of wLCG/EGEE. This scheme has allowed one not to transfer the whole local network to more powerful channels (10GbE, or Infiniband), that would demand significant monetary expenses.
Archive: 2007, 2008
   Copyright © LIT, JINR , 2006
    Webmaster : @jinr.ru

|    About    |    News    |    Activities    |    Computing & Information resources    |