2007年7月5日 星期四

Network test plan

Test plan for dcs5221

Scope
  • Hardware functional test
  • Performance test
  • Stability test
  • Software functional test
  • Usability test
Environment
  • Wired network
  • Wireless network
  • Internet
  • proxy?
Tools
  • 100 feet RJ-45 network cable
  • 10MB Hub/Switch and 100MB Hub/Switch
  • Crossover network cable
  • Chamber for Wi-Fi test
  • DHCP server
  • DNS server
  • DDNS server
  • PPPoE account
  • Mail server
TestCase
  • Hareware functional and performance test
    • 10MB/100MB/POE? plug/unplug test
      • Network LED on/off with plug/unplug
      • Network LED on/off status at booting process.
      • Network LED on/off control spec?
      • POE device LED color and blink?
    • 10MB/100MB/POE? connections via 100 feet network cable
      • The throughput must be similar with short length network cable
      • Record the throughput in our documents.
      • Network LED blink normally?
      • POE LED color and blink?
    • Wireless operative distance and performance test(In chamber)
      • (Be careful about the effect in antenna and outer casing!)
      • Infrastructure/Ad-hoc distance and performance
      • Infrastructure/Ad-hoc distance and performance with different security mode.
      • Throughput control with AP support.
  • Stability test
    • Using iperf to generate packages in/out 5221 (Trying to run monkey test).
    • More than 10 connections to get streaming form 5221 for 30 days+.
    • Setting DHCP server with very short release time, to observe memory.
    • PPPoE connect/disconnect behavior.
    • DDNS update in very short time.
    • Logs re-generate.(Not only for network test.)
  • Software functional and usability test
    • Device need to reboot after network settings change <-- need be improved as soon as possible.
    • 10MB/100MB/Wireless plug/unplug test
      • Only wired MAC address stored in bonding driver.
      • Bonding driver switch between Wired/Wireless smoothly.
    • DHCP client-server test.
      • Test both wired/wireless/POE?
      • Especially focus in time to release period and IP changed situation.
      • DHCPOFFER package contains DNS information. (or more?)
    • Wireless Infrastructure/Ad-hoc mode test
      • WEP with none or 64/128bits|ASCII/HEX key
      • Infrastructure mode in WPA-PSK with TKIP/AES key
      • Ad-hoc mode in WPA-None?
      • Infrastructure with WPA2?
      • Wireless security mode with DHCP?
    • PPPoE test
      • PPPoE connection
      • PPPoE mail
    • DDNS test
      • DynDNS, 3322, ..., etc.
      • DDNS update period.
      • DDNS via UPnP(via NAT)
    • Error handling for web configurations/applications
      • IP address/Subnet mask/Gateway
      • DNS server address
      • PPPoE account/password
      • DDNS server name/account/password
      • ESSID
      • Connection mode/Security mode selections(i.e. Ad-hoc don't support WPA-PSK)
      • WEP/WPA key restrict and warning messages.
      • Site Survey

Questions & Solutions

  • Do not have spec.
    • Do it right now
    • Add in version control systems
    • Public to web interface from version control systems to share to everyone who needs it.
  • Branches and merge
    • Get support from RD leader
    • Introduce branch and merge concept to engineer
    • Do it from spec. and CGI documents at first.
  • Two bug tracking systems
    • Waiting TSV to improve...