How do you evaluate the performance of a BAS project?

Before starting a BAS program, set clear and measurable goals. Decide what you want to achieve, such as energy efficiency, increased occupant comfort, reduced operating costs, increased system reliability. Defined goals provide direction, align stakeholders, and provide the basis for performance evaluation. By specifying the goals and expected results, you create indicators to measure the success of your BAS implementation.

Building a successful Automation System benefits from an Lean-Agile or Hybrid approach. Designing the project tasks and activities in a waterfall system actually increases the risks of missing the target (and business value) significantly. Why? Silo's limit collaboration and the rigidity of Waterfall limits agility to change - which is constant. Hot tip: understand the problem, and build out milestones. Assign cross-functional team members to deliver each milestone, and cross-check the business value at the end of each sprint. Adapt each sprint based on priority and relevance amidst change. Some activities will need to occur in sequence, which can be accommodated in agile or hybrid approaches.

Before starting a BAS project, the client or appointed design engineer should produce a project-specific BAS specification or Scope of Works document. These documents outline the project's end goals—such as energy savings, occupant comfort, or code requirements—and should align with the client’s and stakeholders’ vision and operational needs. Clear objectives in the contract documents ensure team alignment across disciplines, including installation and commissioning. The specification or Scope of Works should also outline timelines or refer to the project schedule and address ambiguities, typically via the Request for Information (RFI) process.

For a BAS project, key performance indicators (KPIs) can be measured either against standards outlined in the specification document or through specific controller responses. System performance is verified and fine-tuned during the commissioning phase of the project. Loop tuning should also be carried out at this stage, but it’s essential to note that an unoccupied building responds differently than a fully occupied one. This is why soft landings is such an important concept to a successful project.

Select key performance indicators (KPIs) that align with your goals and provide measurable data to evaluate progress. KPIs may include utilization levels, system uptime, maintenance costs, and occupant satisfaction scores. Make sure these indicators are specific, meaningful and measurable. Choosing the right KPIs allows for an authoritative assessment of BAS performance and helps to identify areas that need to be improved, making it a valuable monitoring and decision-making tool.

Collect data from various sources, such as sensors, meters, and system logs, to monitor selected KPIs. Use reliable data collection methods to ensure accuracy. Analyze data using appropriate tools and software to identify trends, patterns and anomalies. This analysis allows you to understand how the system is working, identify weaknesses, and make decisions. Regular data collection and analysis is essential for tracking progress toward goals and continuous improvement.

Gather data from the BAS system, sensors, meters, and other relevant sources to assess performance against the chosen KPIs. Utilize data visualization tools, dashboards, and analytics software to analyze the data and identify trends, patterns, and anomalies.

Effective data collection relies on setting the correct interval, as too much or too little data can hinder analysis. Trend logs should be configured for later review, with modern controllers enabling change of value recording, which logs data only when a variable changes by a set amount (e.g., 0.5°C). This approach prevents data overload. The COV threshold must be chosen carefully, guided by sensor characteristics like accuracy, repeatability, and controller resolution. Techniques such as integrating absolute error and disturbance analysis (e.g., autocorrelation) can then detect issues like control loop oscillations or sensor drift. These calculations may be done in software or manually in Excel, enhancing BAS efficiency and performance.

Validate that the BAS is working as intended by comparing analyzed data with goals and KPIs. Verification is to ensure that all components are installed correctly and perform according to specifications. This may include tests, inspections and system repairs. Validation and verification ensure that the BAS meets design and performance requirements, and depend on the reliability and effectiveness of the system.

System performance validation begins during commissioning, when the system is brought online and initial loop tuning is performed. After all I/O points are commissioned, software functionality verified, and control loops tuned, a commissioning agent may verify that the system meets the Scope of Work requirements. Care must be taken, as an unoccupied building behaves differently from an occupied one, requiring soft landings or seasonal commissioning. The final step is sign-off by the design engineer and end client after witnessing system operation and resolving performance issues. For pharmaceutical projects, the Commissioning, Qualification, and Validation (CQV) engineer verifies performance and provides sign-off once issues are resolved.

Communicate performance results directly to all stakeholders through clear and concise reports. Use visual aids such as charts and graphs to show key findings and trends. Reports should highlight accomplishments, areas for improvement, and recommendations for future work. Clear communication encourages stakeholder participation, supports decision-making, and demonstrates the value delivered by the BAS program.

Trend logs are valuable for demonstrating system performance over time, offering stakeholders insight into system behavior. A printout of control loops and process variables, with marked-up commentary explaining instances where the system deviated from setpoints, should be provided. For example, a pressure drop in a room due to an open door may prompt the fan speed or air damper to adjust. Accepted performance reports with clear commentary help drive projects to closure. Performance issues should be documented in a snag list, ensuring they are addressed systematically. Official reporting clarifies responsibility, promoting transparency and client satisfaction for successful project completion.

Performance appraisal is an ongoing process. Continuously monitor the BAS for any abnormalities or problems. Develop a maintenance and optimization strategy to address issues and improve system efficiency. Periodically review KPIs and adjust strategies as necessary to adapt to changing circumstances or goals. Continuous improvement ensures that the BAS continues to meet or exceed performance expectations over time.

Implement a continuous monitoring and improvement process to track ongoing performance and identify opportunities for optimization. Proactively address any issues or discrepancies identified during performance evaluation and adjust BAS settings or strategies as needed to improve performance.

Consider things like user training, cybersecurity, scalability, environmental impact, and compliance. With proper training users can operate and maintain the BAS. Implement cybersecurity measures to protect against threats in connected systems. A Scalable Plan can adapt to future needs without major adjustments. Environmental impact assessment aligns the project with sustainability goals and ensures compliance with regulations to avoid legal issues and promote best practices.

Regularly review and update performance goals and KPIs to reflect changing priorities, technological advancements, and evolving industry standards. Foster collaboration and knowledge sharing among project stakeholders to leverage collective expertise and insights for optimizing BAS performance. Stay informed about emerging trends, best practices, and innovative solutions in building automation and control systems to drive continuous improvement in BAS project performance.