What is a Technology Stack?
A technology stack (Tech Stack) is a set of software code that is made up of modules used in software products and programming languages to build (develop/code) a software application.
The lower in a Tech Stack you go the closer you get to the hardware, for example an Operating System is the part of the tech stack that provide an interface between the computer user and the computer hardware, it communicates directly with the computer hardware. The higher you go in a Tech Stack the more specific and specialized the functionality becomes for example a DBMS (Database Management System) that provides the interface and platform to manipulate, store, manage and administrate data into databases.
Choosing a Primary Tech Stack usually involves the choice of the Operating System, programming languages, standard development libraries, frameworks, DBMS and a support community. The Primary Tech Stack will be used by most of the developers and software engineers in building the software product/application but several Secondary Tech Stacks may be used in support of the Primary Tech Stack to fulfill specific specialized requirements.
There are lots of different, competing technologies made up of different tech stacks, to build a website or software application with. A software application usually consist of the following main components: the Front End of the site/application (what the end users see on the screen and will be interacting with), the Admin Portal (that the application/program administrators or back office personal will use as an interface to administer and manage the application or site), the Middleware, Logical Layer or Application Layer (that performs all the 'automatic' actions and is the heart of the application doing all the calculations, processing and data manipulation), and the Database where all data used within the application or site is stored. Each of these components making up an application or website can be developed with a different software product or programming language but preferably within the same Tech Stack to reduce the complexity of supporting the application/site.
What factors to consider in choosing the right Technology Stack?
When choosing your tech stack it is important to choose components that designed to easily integrate frontend technology must integrate with the admin, logic and database. The integration of the different application components is illustrated in the hand drawn diagram.
- Development Lapse Time / Time to Market: How long will it take to develop an application in one tech stack vs the other. If the tech stack give you access to frameworks and platforms it will reduce the development lapse time and hence your time to market (in other word the application can be developed quicker).
- Compatibility: Will the new technology work with exiting tools and software used within the business? Can you reuse previous developed software code in the new tech stack? Integrating the new tech stack into your existing environment, will it cause disruption or large quantities of rework of existing systems and infrastructure?
- Cutting (Bleeding) Edge: The more cutting edge the technology the more bumps their will be on the road ahead as the cutting edge still has some way to go to maturity and stability.
- Productivity: If you already have a development team in-house, are they qualified to work with the tech stack? Do the developers have any issues with the new tech stack? What issues and pain did you and your development team have with the previous tech stack - are those addressed in the new?
- Engineering Talent Availability: Is the right people available to support the tech stack you intend to use? The right people will be across the board including, architects, tech leads, senior developers, developers, database developers / administrators, etc. Will it be easy to find these people? This is linked to the popularity of the tech stack - the more popular the more talent will be available. Where (in which location) will you need the talent - what is the availability of the talent in your preferred location, the location where you want to build you in-house and offshore teams?
- Recruitment and Retention: How will you recruit the talent for the tech stack? Will, what you have to offer (salary, working environment, training, personal growth, business prospects and growth, etc.), be attractive to the market of professional knowledge workers (technologist)? Make sure that you can recruit and retain your technology staff to support your tech stack, otherwise it might be an expensive choice.
- Expertise: What level of expertise on the new tech stack do you have within your (in-house or outsourced, on-shore, near-shore or off-shore). Make sure that you have staff that are well experienced with the tech stack and ensure that they understand your business drivers and your requirements. Ensure that within your team you have enough experts (at the right levels i.e. Tech Leads & Senior Developers) that thoroughly understand the tech stack intrinsically.
- Scalable: Scalability refers to the ability of a solution to easily adapt to service more users, process more data within a specific time-frame without increasing the overall software and development cost. Hardware is mostly directly related to the scalability for example the more the solution scale the more hardware might be needed to support the technology solution. Scaling can take place horizontally - that is adding more hardware (servers) to the overall solution or vertically which increases the ability to process more data and/or request/users on a particular server. Will the tech stack scale to meet your requirements in performance? How easy is it to scale the solution horizontally? How does the tech stack compare with others in vertical scaling? If you know your solution will be receiving high traffic (lots of users) or will be processing loads of data, the choice of your tech stack becomes very important. The difference in the scalability of two tech stacks can be seen in timing and comparing the systems' response in processing the same amount of user requests or data for example: Ruby is 30 x slower than C, PHP is only 8 x slower than C, Java is a mere 2 x slower than C.
- Community: How strong is the community for your selected tech stack? A strong community is a key factor in selecting a tech stack as an active and devoted community ensures the following:
- Availability of Documentation
- Fast response to bugs, issues and problems.
- Response and support to resolution of issues that might appear to be specific to your solution.
- Availability of issue and problem solutions and the source code to copy/paste speeds up the resolution.
- Continuous updating of the basic framework, increasing the availability of modules and libraries, producing new releases that results in a more stable tech stack.
- Availability of resources/talent understanding the tech stack.
- Quality of Tools: Ensure the tech stack provide adequate tools to the development and support teams to use for example IDEs (Integrated Development Environment), SDKs (Software Development Kits), Debuggers, Build Tools, etc. Adequate tools will ensure you have an empowered and engaged development team that can get the job done.
- Licensing: Tech stacks are licensed differently - either Open Source or Commercial licensing applies. Open Source tech stack has grown tremendously over the past view years. Statistics show that on the internet, more open source tech stack driven solutions (solutions based on the LAMP stack consisting of Linux, Apache, MySQL and PHP) are present than commercial tech stack based solutions like Microsoft consisting of Windows server, IIS, SQL Server and .NET. When deciding on a tech stack it is important to understand the different licensing types and the associated cost of the license to use the software not just for development, but commercially in the mainstream production environments of your business. Open Source licenses are usually cheaper than commercial licenses. Make sure that you understand the type of license the tech stack components are under and that you have the associated budget.
- Hardware Resource Hungry: What level (quantity and specification) of hardware will the tech stack require to run your application effectively according to expectations and requirements? Some tech stacks require several different servers to run a single application dependent on the complexity. This should be taken into consideration especially in conjunction with the budget constraints. Tech stack and hardware requirements are dependent on the performance and uptime requirements of the operational technology solution. A solution that needs to be up and running every second of every day and/or are procession large volumes of data in the shortest possible time, will have a higher dependency on the hardware with infrastructure design incorporating the resilience against hardware and connectivity failures. Hardware is not directly dependent on the tech stack for redundancy but some tech stacks are better suited for high availability with build in capabilities, than others.
- Popularity: I would say the hot open source development stacks right now are LAMP, MEAN and ROR.
- Linux, Apache, MySQL, PHP
- Low Barrier to Entry
- Great Documentation
- Large Community
- The Original Stack
Why LAMP? Easy to learn, huge community of developers keeping costs down, Lots for frameworks to speed development. Used by Facebook and Truelancer
- MongoDB, ExpressJS, AngularJS, NodeJS
- Real-time Features
- Live notifications/updates
Why MEAN? Fast, scalable, powerful, large community of developers. Used by Umber
- Ruby, Rails Framework, Active Record
- Fast development
- Easy library integration (Gems)
- Human like language
- Syntactic Sugar
Why ROR? Fast development, scalable, small community of developers who are expensive. Used by Twitter, Shopify, Groupon
- Future Proof: This is a relative concept because none of us have a crystal ball to gage exactly what the future will hold in order to choose our tech stack accordingly. How long into the future are you looking to proof your application, recognizing that technology is rapidly changing and no single tech stack has ever been and will ever be available and around for ever. Even tech stacks like Microsoft that has been around for twenty plus years has changed within and the older tech stacks from Microsoft are absolute while newer options are introduced every two to three years sometimes without appropriate backwards compatibility. Your tech stack must be agile (adapt to change), backwards compatible, scalable (to accommodate your business and market growth), from a reputable supplier (a supplier that is credit worthy and likely to be around for the future) and popular. Popularity is very important and the community following, embracing and developing a tech stack will ensure the availability of talent and support resources to ensure your application build in a particular tech stack can be supported long into the future.
- Documentation: Are the appropriate documentation available for the tech stack to completely enable your team to utilize its full power? Documentation includes printed manuals, internet information resources, sample code, module and libraries, community forums where issues and problems are discussed and resolved with solution code that can easily be copied/pasted.
- Maturity/Stability: What is the latest released version of the tech stack. A mature tech stack with release versions will be much more stable than a version 1 release, for example.
- Company Constraints: Is your tech stack choice affected by certain constraint within your business i.e. if you are looking to develop a native mobile application for iPhone or iPad who have no other choice but Objective C for your programming language. Do you have access to a DevOps team (operations team ensuring the software development and operational infrastructure seamlessly integrate)? If not, you might want to consider a PaaS option and use the stack it supports. Other constraints can be: legal requirements like PCI DSS (Credit Card and Personal Information security legislation and requirements), budget and operational costs.
What are the most popular choices in Technology Stacks?
Associated Web Framework
Cloud PaaS (Platform as a Service)
The challenge today is choosing a Tech Stack, which supports current trends, and also future proofs your technology solution for the future. You can only focus your choice towards the Tech Stack that will be appropriate and the best fit for your business today and with that realize that the Tech Stack might change in the future as technology evolves - in other words there is no such thing as a fully future proof tech stack.
- What Tech Stack are you and/or your organization using and why?
- How was this choice made?