Source (game engine)
||It has been suggested that Valve Hammer Editor and Source SDK be merged into this article. (Discuss) Proposed since March 2015.|
|Stable release||Build 5595 / 2014|
Source is a 3D video game engine and the successor for GoldSrc both developed by Valve Corporation. It debuted in June 2004 with Counter-Strike: Source, followed shortly by Half-Life 2, and has been in active development ever since. Source does not have a meaningful version numbering scheme; instead, it is designed in constant incremental updates.
- 1 Notable technology
- 2 Modularity and notable upgrades
- 3 Source Dedicated Server
- 4 Future technology
- 5 Origins
- 6 Criticism
- 7 Valve Developer Community
- 8 Papers
- 9 Games using Source
- 10 See also
- 11 References
- 12 External links
These are some notable technologies (a full list of features can be found at Valve's Developer Feature List.):
- Direct3D rendering on Microsoft Windows, Xbox and Xbox 360; OpenGL rendering on Linux (including SteamOS), OS X and PlayStation 3; OpenGL ES rendering on Android.
- High dynamic range rendering, or HDR.
- Lag-compensated client-server networking model
- Network-enabled and bandwidth-efficient physics engine (derived from Havok).
- Scalable multiprocessor support
- Pre-computed radiosity lighting and dynamic shadow maps. Deferred lighting is supported on consoles.
- Facial animation system. Lip-sync using the system is auto-generated and localizable.
- Blended skeletal animation system, including inverse kinematics
- Water flow effects
- 3D bump mapping
- Dynamic 3D wounds
- Alpha to coverage edge smoothing for foliage etc.
- Map-logic scripting with Squirrel programming language.
- Significant source code access for mod teams
- Distributed map compiler
- Keyframed vertex animation (introduced in Dota 2)
The Source Filmmaker (SFM) is a video capture and editing application that works from within the Source engine. Developed by Valve, the tool was used to create movies for Team Fortress 2, the Left 4 Dead series, Portal 2, and more. Today, it is open for public use and downloadable via the Steam client.
Modularity and notable upgrades
Source was created to evolve incrementally as technology moves onwards, as opposed to the backwards compatibility-breaking "version jumps" of its competitors. With Steam, Valve can distribute automatic updates with new versions of the engine among its many users.
In practice, there have been occasional breaks in this chain of compatibility. The release of Half-Life 2: Episode One and The Orange Box both introduced new versions of the engine that could not be used to run older games or mods without the developers performing upgrades to code and, in some cases, content. Both cases required markedly less work to update its version than competing engines. This was demonstrated in 2010, when Valve updated all of their core Source games to the latest engine build.
Since Source's release in 2004, the following major architectural changes have been made:
- High dynamic range rendering (2005, Half-Life 2: Lost Coast)
- Simulation of a camera aperture and the ability to fake the effects of brightness values beyond computer monitors' actual range. Required all of the game's shaders to be rewritten.
- "Soft" particles (2007, The Orange Box)
- An artist-driven, threaded particle system replaced previously hard-coded effects.
- Hardware facial animation (2007, The Orange Box)
- Hardware accelerated on modern video cards for "feature film and broadcast television" quality.
- Multiprocessor support (2007, The Orange Box)
- A large code refactoring allowed the Source engine to take advantage of multiple CPU cores on the PC, Xbox 360 and PlayStation 3. On the PC, support was experimental and unstable until the release of Left 4 Dead. Multiprocessor support was later backported to Team Fortress 2 and Day of Defeat: Source.
- Xbox 360 support (2007, The Orange Box)
- Valve created the Xbox 360 release of The Orange Box in-house, and support for the console, unlike support for the PlayStation 3, is fully integrated into the main engine codeline. It includes asset converters, cross-platform play and Xbox Live integration. Program code can be ported from PC to Xbox 360 simply by recompiling it.
- PlayStation 3 support (2007, The Orange Box)
- Source first appeared on the PlayStation 3 in 2007, but with an engine port that was created externally and which was plagued with issues. Valve took the problem in-house for Portal 2, and in combination with Steamworks integration created what they called "the best console version of the game".
- Mac OS X support (2010, multiple games)
- In April 2010 Valve released all of their major Source games on Mac OS X. All future Valve games will be released simultaneously for Windows and Mac. Games will only use Direct3D on Windows and Xbox 360 while using OpenGL on the other platforms.
- Linux support (2012, multiple games)
- The first of Valve's games to support Linux was Team Fortress 2, the port released in October 2012 along with the closed beta of the Linux version of Steam.
- Android support (2014, Portal, Half-Life 2)
- In May 2014, Nvidia released ports of Portal and Half-Life 2 to their Tegra 4-based Android handheld game console Nvidia Shield.
Source Dedicated Server
The Source Dedicated Server or SRCDS is a tool that runs the server component of a Source game without the client component. In other words, it simulates the game without drawing it. SRCDS is chiefly used by server providers who want to serve up as many games from the same computer as they can.
The ports SRCDS officially uses are:
- 26901 UDP (master server)
- 27015 TCP/UDP (game transmission, pings and RCON)
- 27020 UDP (SourceTV transmission)
SRCDS has also been spotted opening connections on 27005 and 51840 UDP, but these may be outbound only.
A Source engine based multiplayer game can be hosted in three different ways:
- Inside the game client (a listen server).
- Using the Steam-based dedicated server (only available on Windows).
- Using a standalone dedicated server.
Most high-performance servers use the third option. The Windows build of the standalone dedicated server can optionally be run with a graphical front-end, but graphical is the default mode when running in Steam. Most often commercial game server hosts choose the Linux build as it is regarded as a more flexible server operating system with higher performance.
Most online Source servers are dedicated servers running SRCDS, as opposed to listen servers. SRCDS-servers can be remotely controlled using RCON. SRCDS servers can host additional custom content for games, which can be downloaded to players, when they join the server. This made it possible to make custom maps (such as fy or fight yard) available, that were not shipped with the original Source games.
Using Metamod:Source, the server can load and unload dynamic library modules (.so on Linux, .dll on Windows). The most popular MetaMod:S plugin is SourceMod. SourceMod is a big Administration Tool for the Source Engine. Most SRCDS servers use SourceMod or MetaMod:S in some way.
As of May 2011, one of Valve's largest projects is the development of new content authoring tools for Source. These will replace the current outdated tools, allowing content to be created faster and more efficiently. Studio head Gabe Newell has described the creation of content with the engine's current toolset as "very painful" and "sluggish".
In 2013, an update was released for Source SDK that allowed users to build OS X and Linux versions of their mods. Additionally, support was added for Valve's new Steampipe content distribution system as well as the Oculus Rift.
Source 2 engine
In August 2012, the Valve fan site ValveTime speculated that Valve might be in development of a "Source 2" engine, based on coding from the Source Filmmaker that directed technology from the upcoming version. Later that year, in November, Gabe Newell confirmed that a Source 2 engine is under development, and that Valve is "waiting for a game to roll it out with".
On January 27, 2014, a Neogaf user known as CBOAT posted a leaked PowerPoint presentation showing multiple screenshots of the Source 2 engine. The screenshots show an updated version of the Plantation map from Left 4 Dead 2 with enhanced lighting and shadows, improved foliage, and higher quality models.
On August 7, 2014, Valve announced the alpha release of Dota 2 Workshop Tools with the entirety of the game's code and assets ported over to a new engine, leading many to speculate on a possible "soft release" of the Source 2 engine.
Image-based rendering technology had been in development for Half-Life 2 but was cut from the engine before its release. It was mentioned again by Gabe Newell in 2006 as a piece of technology he would like to add to Source to implement support for much larger scenes that are impossible with strictly polygonal objects.
One of the technologies developed for Half-Life 2 's Xbox release was file streaming, wherein a map's resources could be loaded as the player moved around in it rather than in one operation before playability. With the system in place, loading times were reduced to as little as fifteen seconds. The system expanded on the caching system already implemented. There is no time frame for its release, as implementing such a system on the potentially infinite variations of PC hardware setups in use supposedly poses serious performance problems. However, this has not interfered with successful implementations of large-scale streaming in other modern engines on all platforms.
Source distantly originates from the GoldSrc engine, itself a heavily modified version of John D. Carmack's Quake engine. Carmack commented on his blog in 2004 that "there are still bits of early Quake code in Half-Life 2". Valve employee Erik Johnson explained the engine's nomenclature on the Valve Developer Community:
When we were getting very close to releasing Half-Life (less than a week or so), we found there were already some projects that we needed to start working on, but we couldn't risk checking in code to the shipping version of the game. At that point we forked off the code in VSS to be both
/$Src. Over the next few years, we used these terms internally as "Goldsource" and "Source". At least initially, the Goldsrc branch of code referred to the codebase that was currently released, and Src referred to the next set of more risky technology that we were working on. When it came down to show Half-Life 2 for the first time at E3, it was part of our internal communication to refer to the "Source" engine vs. the "Goldsource" engine, and the name stuck.
Source was developed part-by-part from this fork onwards, slowly replacing GoldSrc in Valve's internal projects and, in part, explaining the reasons behind its unusually modular nature. Valve's development of Source since has been a mixture of licensed middleware (Havok Physics, albeit heavily modified, and MP3 playback) and in-house-developed code.
The Source SDK tools are criticised for being outdated and difficult to use.[better source needed] A large number of the tools, including those for texture and model compilation, require varying levels of text-editor scripting from the user before they are executed at the command line; with sometimes lengthy console commands. This obtuseness was cited by the University of London when they moved their exploration of professional architectural visualisation in computer games to Bethesda Softworks' Gamebryo-based Oblivion engine after a brief period with Source. Third-party tools provide GUIs, but are not supported by Valve.
Valve Developer Community
On June 28, 2005, Valve opened the Valve Developer Community wiki. VDC replaced Valve's static Source SDK documentation with a full MediaWiki-powered community site; within a matter of days Valve reported that "the number of useful articles nearly doubled". These new articles covered the previously undocumented Counter-Strike: Source bot (added by the bot's author, Mike Booth), Valve's NPC AI, advice for mod teams on setting up source control, and other articles.
Valve staff occasionally produce professional and/or academic papers for various events and publications, including SIGGRAPH, Game Developer Magazine and Game Developers Conference, explaining various aspects of Source's development.
Games using Source
- Half Life 2 (2004)
- Half-Life 2: Deathmatch (2004)
- Half-Life: Source (2004)
- Counter-Strike: Source (2004)
- Day of Defeat: Source (2005)
- Half-Life 2: Lost Coast (2005)
- Half-Life 2: Episode One (2006)
- Half-Life 2: Episode Two (2007)
- Team Fortress 2 (2007)
- Portal (2007)
- Left 4 Dead (2008)
- Left 4 Dead 2 (2009)
- Alien Swarm (2010)
- Portal 2 (2011)
- Counter-Strike: Global Offensive (2012)
- Dota 2 (2013)
Games by other developers
- Vampire: The Masquerade – Bloodlines (2004)
- Garry's Mod (2004)
- SiN Episodes (2006)
- Dark Messiah of Might and Magic (2006)
- The Ship (2006)
- Insurgency (2007)
- Zeno Clash (2009)
- Bloody Good Time (2010)
- Vindictus (2010)
- E.Y.E.: Divine Cybermancy (2011)
- Nuclear Dawn (2011)
- Postal III (2011)
- Dino D-Day (2011)
- Dear Esther (2012)
- Black Mesa (2012)
- Tactical Intervention (2013)
- The Stanley Parable (2013)
- Contagion (2013)
- NeoTokyo (2014)
- Blade Symphony (2014)
- Titanfall (2014)
- Crossley, Rob (May 12, 2011). "Valve on Source and studio culture". Develop Magazine. Retrieved August 14, 2011.
We have as many people working on our tools as we have working on a single project. So, about twenty to thirty core people.
- "Source Multiplayer Networking". Valve Developer Community. 2005-06-30. Retrieved 2008-07-20.
- "VPhysics". Valve Developer Community. Retrieved 2011-08-15.
- "Multi-Core in the Source Engine Core". Bit-tech. 2006-11-02. Retrieved 2006-11-02.
- "Source - Rendering System". Source Engine Brochure. Valve Corporation. Retrieved August 15, 2011.
- "Face-to-Face with TF2's Heavy". Steam news. 2007-05-14. Retrieved 2010-04-25.
- "$sequence". Valve Developer Community. 2007-09-08. Retrieved 2008-07-20.
- "$ikchain". Valve Developer Community. 2007-09-08. Retrieved 2008-07-20.
- Vlachos, Alex (July 28, 2010). "Water flow in Portal 2". Valve Corporation.
- "Valve's Developers community page for Bump Mapping". Valve Corporation. May 14, 2013.
- Vlachos, Alex (March 9, 2010). "Rendering Wounds in Left 4 Dead 2". Valve Corporation.
- "$distancealpha". Retrieved 2009-07-05.
- "Improved Alpha-Tested Magnification for Vector Textures and Special Effects". SIGGRAPH 2007. 2007-08-05. Retrieved 2008-05-20.
- "L4D2 VScripts". Valve Developer Community. Retrieved February 12, 2010.
- "Mod wizard complete". Valve Developer Community. 2008-02-24. Retrieved 2008-07-20.
- "VMPI". Valve Developer Community. Retrieved December 5, 2008.
- "Vertex animation". Retrieved May 4, 2014.
- "Source Filmmaker". Source Filmmaker. Retrieved 31 March 2013.
- "New Update Breaking New and Old Mods?". PlanetPhillip. Retrieved 2014-10-17.
- "Source 2009". Valve Developer Community. Retrieved 17 September 2010.
- Valve Corporation. "Half-Life 2: Lost Coast" PC.
Chris Green: The Source engine supports a wide variety of shaders. The refraction shader on the window here requires us to copy the scene to a texture, refract it, and then apply it the window surface. To fully support HDR, every shader in the engine needed to be updated, so this refraction shader was improved to the support the full range of contrast.
- "Interview: Gabe Newell". PC Zone. 2006-09-11. Retrieved 2006-09-20.
- "Dual Core Performance". 2008-10-11. Retrieved 2008-12-23.
- Lombardi, Doug (2008-05-13). "PCGH interview about Left 4 Dead, part 2". Interviewer: Frank Stöwer. Retrieved 2008-12-23.
- Nick, Breckon (2008-03-18). "Team Fortress 2 Update Adds Multicore Rendering". Retrieved 2009-08-19.
- "Source - Console Support". Valve. Retrieved August 8, 2009.
- "Joystiq interviews Doug Lombardi about Xbox 360 Source". Joystiq. October 17, 2006. Retrieved August 8, 2009.
- "Portal 2: Pretty Much Every PS3 Question Answered (And That Cake Thing, Too)". Sony Computer Entertainment America. April 14, 2011.
- "Valve to Deliver Steam & Source on the Mac". Valve. 2010-03-08. Retrieved 2010-03-08.
- "Left 4 Dead 2, Team Fortress 2, Portal and Steam Coming to Mac in April". Kotaku. 2010-03-08. Retrieved 2010-03-08.
- "The Greatest PC Games of All-Time – ‘Half-Life 2′ and ‘Portal’ – Now Available on SHIELD". Nvidia. 2014-05-12. Retrieved 2014-05-12.
- Source Dedicated Server Valve Dev Wiki
- "The Future of Linux". Novell. Retrieved 2010-10-17.
- "Steamcast #47". Steamcast. February 9, 2011. Retrieved August 14, 2011.
Oh yeah, we're spending a tremendous amount of time on tools right now. So, our current tools are... very painful, so we probably are spending more time on tools development now than anything else and when we’re ready to ship those I think everybody's life will get a lot better. Just way too hard to develop content right now, both for ourselves and for third parties so we’re going to make enormously easier and simplify that process a lot.
- "Source SDK 2013 Release". Steam News. Valve Software. Retrieved 4 July 2013.
- -smash- (6 August 2012). "EXCLUSIVE: Next-Gen Source 2 Engine Is In Development".
- "Gabe Newell confirms Source Engine 2 has been in development for a while, Valve are "waiting for a game to roll it out with"". PCGamesN. 11 December 2012. Retrieved 15 February 2013.
- "Possible proof of Source 2 and Left 4 Dead 3.". "Game Trailers". August 6, 2013.
- Omnomnick (27 January 2014). "Source 2 Left 4 Dead 2 Prototype Screenshots Leaked". Retrieved 27 January 2014.
- "valve dota 2 workshop tools announcement". www.eurogamer.net. Retrieved 7 August 2014.
- "Source 2 possible soft launch". www.eurogamer.net. Retrieved 7 August 2014.
- Philip Kollar (3 March 2015). "Valve announces Source 2 engine, free for developers". Retrieved 3 March 2015.
- Mahardy, Mike (3 March 2015). "GDC 2015: Valve Announces Source 2 Engine". IGN. Retrieved 3 March 2015.
- "Interview with Gabe Newell". DriverHeaven.net. Retrieved 2009-11-21.
- "Valve Week". 1UP.com. Retrieved 2006-07-14.
- "Welcome, Q3 source, Graphics". John Carmack's Blog. 2004-12-31.
- Johnson, Erik (2005-09-01). "Talk:Erik Johnson". Valve Developer Community. Retrieved 2007-08-15.
- Hodgson, David (2004). Half-Life 2: Raising the Bar. Prima Games. ISBN 0-7615-4364-3.
- Roberts, Neale (November 15, 2006). "Stuck Valve". Dirigible Development Diary. Archived from the original on 2007-12-27. Retrieved December 20, 2007.
- Jedrzejewski, Neil (July 23, 2009). "Re: whats happening with this engine". hlcoders (official Valve mailing list). Retrieved July 29, 2009.
- "Vtex CLI use". Valve Developer Community. August 28, 2007. Retrieved July 21, 2008.
- "Half Life 0 Oblivion 1 - Half Life Update". Digital Urban. September 28, 2006. Retrieved December 20, 2007.
- "Category:Third Party Tools". Valve Developer Community. Retrieved October 20, 2007.
- "Valve Publications". Retrieved 25 September 2013.
- "Vampire: The Masquerade - Bloodlines Designer Diary #3". GameSpot. 2003-12-16. Retrieved 2015-01-04.
- "Hieronymus: ACE Team Explain Zeno Clash II". Rock, Paper, Shotgun. 2012-06-07. Retrieved 2015-01-04.
|Wikimedia Commons has media related to Source (game engine).|