100G Transit (LC SMF / LR4)
100G Fabric (MTP-12 / SR4)
Server (10G DAC / 1G RJ45)
CARRIERS
ARELION
PA6 Local
TATA
PA2 XC
EuNetworks WAVE
PA2 XC | DCI to AMS
GTT
PA2 XC
ZetNet (L2)
PA2 XC
5x FlexOptics 100G LR4
RACK 1
core1
7280QR-C36
agg1
7060CX-32S
TOR1 7050SX-64
IPMI1 7010T-48 | LC SMF
36 Servers
10G DAC + Cat6 RJ45
RACK 2
core2
7280QR-C36
agg2
7060CX-32S
TOR2 7050SX-64
IPMI2 7010T-48 | LC SMF
36 Servers
10G DAC + Cat6 RJ45
2x 100G iBGP
4x 100G mesh | MTP-12
4x 40G per rack | MTP-8 OM4 | 2x to each agg
RACK 3
TOR3
IPMI3 | LC SMF
40 Servers
DAC + RJ45
RACK 4
TOR4
IPMI4 | LC SMF
40 Servers
DAC + RJ45
RACK 5
TOR5
IPMI5 | LC SMF
40 Servers
DAC + RJ45
RACK 6
TOR6
IPMI6 | LC SMF
40 Servers
DAC + RJ45
PHASE 2 | RACKS 7-10 | +160 SERVERS
DCI: AMS - PAR
EuNetworks 100G Wave
NIKHEF - PA2 - PA6 campus XC
CABLE TYPES
MTP-12: 100G (core layer)
MTP-8: 40G (agg to TOR)
PHASE 1
6 Racks | 232 Servers
6x 100G fabric | 24x 40G uplinks
SPARES ON-SITE
1x each switch model
All optics + cables
Rack Layout
R1 | Network + Server
core1 | 7280QR-C36 (2U)
agg1 | 7060CX-32S (2U)
TOR1 | 7050SX-64
IPMI1 | 7010T-48 + LC SMF
36x 1U servers
R2 | Network + Server
core2 | 7280QR-C36 (2U)
agg2 | 7060CX-32S (2U)
TOR2 | 7050SX-64
IPMI2 | 7010T-48 + LC SMF
36x 1U servers
R3
TOR3 + IPMI3
40x 1U servers
R4
TOR4 + IPMI4
40x 1U servers
R5
TOR5 + IPMI5
40x 1U servers
R6
TOR6 + IPMI6
40x 1U servers
Bill of Quantities (Active + Spares)
Network Hardware
Item Vendor Active Spare Order
7280QR-C36 (Core) Arista 2 1 3 7060CX-32S (Agg) Arista 2 1 3 7050SX-64 (TOR) Arista 6 1 7 7010T-48 (IPMI) Arista 6 1 7
Optics
Item Vendor Active Spare Order Use
100G QSFP28 LR4 FlexOptics 5 2 7 Carriers 100G QSFP28 SR4 QSFPTEK 12 4 16 Core-Core (4) + Core-Agg (8) 40G QSFP+ SR4 QSFPTEK 48 8 56 Agg-TOR (24 links x 2 ends) 10G SFP+ LR QSFPTEK 12 4 16 IPMI uplinks (6 links x 2 ends)
Fiber Cables (All QSFPTEK)
Type Length Active Spare Order Use
MTP-12 OM4 1-2m 2 1 3 Core-Agg intra-rack MTP-12 OM4 3-5m 4 2 6 Core-Core (2) + Core-Agg cross (2) MTP-8 OM4 1-2m 4 2 6 TOR1/2 to local agg intra-rack MTP-8 OM4 3-5m 4 2 6 TOR1/2 to remote agg cross-rack MTP-8 OM4 5-15m 16 4 20 TOR3-6 to agg1/agg2
Copper & SMF Cables (All QSFPTEK)
Item Active Spare Order Use
10G SFP+ DAC (1-2m) 232 24 256 Server-TOR Cat6 RJ45 (1-2m) 232 24 256 Server-IPMI LC Duplex SMF (IPMI) 6 2 8 IPMI uplink per rack LC Duplex SMF (carrier) 5 2 7 Carrier cross-connects
PORT CAPACITY: 7060CX-32S has 32 QSFP+ ports. Phase 1 = 24 ports (6 racks x 4). Phase 2 at 10 racks = 40, exceeds capacity. Solution: 2x 40G LAG per agg per rack (20 ports for 10 racks) or add third agg switch.