De Silva served on the ICC Elite Umpire Panel between 2002 and 2004 when he was dumped down to the International Panel, but was invited back to the Elite level in April 2008 when the panel was expanded to twelve members. He continued as a member of the ICC International umpire panel in the interim period, being used by the ICC to support the Elite Panel during busy periods in the International cricket season. He umpired in the Cricket World Cup tournaments in 2003, 2007 and 2011. De Silva was moved to less crucial matches during the 2011 Cricket World Cup after a review of his performance. He was subsequently expelled from the Elite Panel for the second time in his career in May 2011. He is the only person to have been given two chances on the Elite Panel, and so holds the dubious record of having his position on the panel terminated twice.