The URL can be used to link to this page

Home My WebLink About20230315 2022 DSM Supplement 2.pdfMARCH 15 2023 SUPPLEMENT 2: E V A L U A T I O N 2022ANNUAL REPORTANNUAL REPORT DEMAND-SIDE MANAGEMENT Printed on recycled paper Supplement 2: Evaluation Demand-Side Management 2022 Annual Report Page i TABLE OF CONTENTS Evaluation and Research Summary ................................................................................................ 1 Evaluation Plan................................................................................................................................ 3 Energy Efficiency Advisory Group Notes ........................................................................................ 5 NEEA Market Effects Evaluations.................................................................................................. 35 Integrated Design Lab ................................................................................................................... 39 Research/Surveys ........................................................................................................................ 201 Evaluations .................................................................................................................................. 249 Other Reports ............................................................................................................................. 447 Supplement 2: Evaluation Page ii Demand-Side Management 2022 Annual Report Supplement 2: Evaluation Demand-Side Management 2022 Annual Report Page 1 EVALUATION AND RESEARCH SUMMARY Idaho Power considers program evaluation an essential component of its demand-side management (DSM) operational activities. The company contracts with third-party contractors to conduct impact, process, and other evaluations on a scheduled and as-required basis. Third-party contracts are generally awarded using a competitive bid process managed by Idaho Power’s Corporate Services. In some cases, research and analysis is conducted internally and managed by Idaho Power’s Research and Analysis team within the Customer Relations and Energy Efficiency (CR&EE) department. Idaho Power uses industry-standard protocols for its internal and external evaluation efforts, including the National Action Plan for Energy Efficiency—Model Energy Efficiency Program Impact Evaluation Guide, the California Evaluation Framework, the International Performance Measurement and Verification Protocol (IPMVP), the Database for Energy Efficiency Resources, and the Regional Technical Forum’s (RTF) evaluation protocols. The company also supports regional and national studies to promote the ongoing validation of energy savings and demand reduction, and the efficient management of its programs. Idaho Power considers primary and secondary research, potential assessments, impact and process evaluations, and customer surveys as important resources in providing accurate and transparent program savings estimates. Recommendations and findings from evaluations and research are used to continuously refine and improve Idaho Power’s DSM programs. In 2021, Idaho Power contracted with ADM Associates and Tetra Tech to conduct program evaluations for the Home Energy Report (impact, ADM Associates), Commercial Energy-Savings Kits (impact and process, ADM Associates), C&I New Construction (impact and process, Tetra Tech), and C&I Retrofits (impact and process, Tetra Tech) programs. Idaho Power also contracted with Applied Energy Group to conduct an Energy Efficiency Potential Study and a Demand Response Potential Study for Idaho Power’s service area. Due to the size of these reports, they are not included in this Supplement 2, but can be accessed by a link found in the Other Reports section. AM Conservation Group conducted a program summary analysis of Student Energy Efficiency Kits and Commercial Energy Savings Kits programs. Harris Utilities conducted a summary analysis for the Home Energy Report Program. The company also conducted internal analyses for the A/C Cool Credit, Flex Peak, and Irrigation Peak Rewards programs. Throughout 2022, Idaho Power administered several surveys regarding energy efficiency programs to measure customer satisfaction. Some surveys were administered by a third-party contractor; other surveys were administered by Idaho Power either through traditional paper and electronic surveys or through the company’s online Empowered Community. An evaluation Supplement 2: Evaluation Page 2 Demand-Side Management 2022 Annual Report schedule and final reports from all evaluations, research, and surveys listed above are included in this Demand-Side Management 2022 Annual Report, Supplement 2: Evaluation. Supplement 2: Evaluation Demand-Side Management 2022 Annual Report Page 3 EVALUATION PLAN Energy Efficiency 2010–2023 Program Evaluation Plans Program Evaluation Schedule 2023 2022 2021 2020 2019 2018 2017 Residential Energy Efficiency Programs Educational Distributions ............................................................. I/P Energy House Calls....................................................................... I/P Heating & Cooling Efficiency Program ......................................... I/P I/P Home Energy Audit ...................................................................... I/P I Home Energy Reports .................................................................. I P Multifamily Energy Savings Program ........................................... I/P Rebate Advantage ....................................................................... I Residential New Construction Program ....................................... I I/P Shade Tree Project....................................................................... I O O Weatherization Assistance for Qualified Customers .................... O O Weatherization Solutions for Eligible Customers ......................... O O Commercial/Industrial Energy Efficiency Programs Commercial Energy-Saving Kits .................................................... I/P Custom Projects ........................................................................... I/P I P New Construction ........................................................................ I/P I P Retrofits ....................................................................................... I/P I P Small Business Direct Install ........................................................ I P Irrigation Energy Efficiency Programs Irrigation Efficiency Rewards ....................................................... I I/P Demand-Response Programs A/C Cool Credit ............................................................................ O O I O I O O Flex Peak Program ....................................................................... O O I/O O O O O Irrigation Peak Rewards ............................................................... O O I/O O O O O Evaluation Type: I = Impact, P = Process, O = Other : Supplement 2: Evaluation Page 4 Demand-Side Management 2022 Annual Report Program Evaluation Schedule 2016 20151 2014 2013 2012 2011 2010 Residential Energy Efficiency Programs Educational Distributions ........................................................ Energy House Calls.................................................................. I P Heating & Cooling Efficiency Program .................................... P I P Home Energy Audit ................................................................. P Home Energy Reports ............................................................. Multifamily Energy Savings Program ...................................... Rebate Advantage .................................................................. I/P I Residential Energy Efficiency Education Initiative .................. O P Residential New Construction Program .................................. Shade Tree Project.................................................................. P Weatherization Assistance for Qualified Customers ............... O P I Weatherization Solutions for Eligible Customers .................... O P I Commercial/Industrial Energy Efficiency Programs Commercial Energy-Saving Kits ............................................... Custom Projects ...................................................................... I/P I P New Construction ................................................................... I I P Retrofits .................................................................................. I P I P Small Business Direct-Install ................................................... Irrigation Energy Efficiency Programs Irrigation Efficiency Rewards .................................................. I/P P/O P/I P Demand-Response Programs A/C Cool Credit ....................................................................... I I O P O Flex Peak Program .................................................................. I/O I/O P/O O Irrigation Peak Rewards .......................................................... O I/O I/O O O Evaluation Type: I = Impact, P = Process, O = Other : 1 Energy efficiency programs evaluated in 2015 have since been combined with another program or eliminated Supplement 2: Evaluation Demand-Side Management 2022 Annual Report Page 5 ENERGY EFFICIENCY ADVISORY GROUP NOTES The following pages include notes from EEAG meetings held on February 9, May 4, August 11, and November 17, 2022. Supplement 2: Evaluation Page 6 Demand-Side Management 2022 Annual Report Energy Efficiency Advisory Group (EEAG) February 09, 2022 Present: Anna Kim – Public Utilities Commission of Oregon Alexa Sakolsky-Basquill – Office of Energy & Mineral Resources Ben Otto – Idaho Conservation League Connie Aschenbrenner – Idaho Power Diego Rivas – Northwest Energy Coalition Don Strickler – Simplot Donn English – Idaho Public Utilities Commission Evie Scrivner – Community Action Partnership Kevin Keyt – Idaho Public Utilities Commission Quentin Nesbitt – Idaho Power Sid Erwin – Idaho Irrigation Pumpers Association Taylor Thomas – Idaho Public Utilities Commission Tina Jayaweera – Northwest Power & Conservation Council Wil Gehl – City of Boise Not Present: Jim Hall – WaFd Bank Kacia Brockman – Public Utilities Commission of Oregon Marissa Warren – Office of Energy & Mineral Resources Nick Saven – Public Utilities Commission of Oregon Guest and Presenters*: Andee Morton – Idaho Power Andrea Simmonsen – Idaho Power Annie Meyer* – Idaho Power Becky Arte Howell – Idaho Power Billie McWinn* - Idaho Power Chad Severson – Idaho Power Callie Freeman – Idaho Power Chellie Jensen* - Idaho Power Cheryl Paoli – Idaho Power Chris Pollow – Idaho Power Curtis Willis – Idaho Power Dahl Bietz- Idaho Power Denise Humphreys – Idaho Power Jeff Rigby – Idaho Power Kathy Yi – Idaho Power Krista West – Idaho Power Melissa Thom – Idaho Power Michelle Toney – Idaho Power Mindi Shodeen – Idaho Power Quentin Nesbitt* – Idaho Power Rito Reynoso – Metro Community Services Rosemary Curtin – Facilitator Shelley Martin – Idaho Power Sheree Wilhite – Idaho Power Theresa Drake – Idaho Power Todd Greenwell – Idaho Power Tonja Dyke – Idaho Power Zack Thompson – Idaho Power Note Takers: Michelle Toney (Idaho Power) and Kathy Yi (Idaho Power) Meeting Facilitator: Rosemary Curtin Virtual WEBEX Meeting Convened at 9:32 a.m. – Rosemary Curtin Rosemary opened the meeting. New EEAG member introduction: Evie Scrivner, CEO Community Action Partnership Association of Idaho (CAPAI) Quentin Nesbitt went over the agenda for today’s meeting. There were no questions or comments on the November meeting notes. 9:39 a.m. Announcements Connie provided regulatory updates. She highlighted the positive order received in the 2020 DSM prudence case and the Commission’s comments specifically acknowledging EEAG’s ongoing participation. Connie also provided a Demand Response (DR) filing update. The Oregon PUC approved the modifications, and the Company expects an Idaho PUC decision in the coming weeks. There were no questions or comments. 9:45 a.m.-2021 Financials & Savings – Quentin Quentin presented preliminary year to date expenses on the Rider and Preliminary savings for all programs. The preliminary savings are down due to COVID. All DR programs are impacted by supply chain and labor issues making participation difficult. Equipment is hard to find/ship and with the new construction in Idaho, contractors are being pushed towards new construction instead of retrofitting old equipment. Quentin also provided an update on the evaluation efforts. One member asked about DR program modifications and mentioned that they thought the Flex Peak program was the lowest cost per MW of savings of the three DR programs. Quentin answered that it has the highest incentive but is lower overall cost per kW because the program has the least administrative cost as there are no devices in the field. Therefore, there is not a need for maintenance or monitoring, unlike the Irrigation and A/C Cool Credit program where there are direct load control devices on customer equipment that need to be installed and maintained. Another member asked about the process for evaluations when a program changes. Quentin responded that the company tries to do a process evaluation if there are significant changes on a program the next year and Idaho Power strives to do impact and process evaluations approximately every 3-5 years. For the DR programs the company does internal impact evaluations every year using the same methods as prior third-party evaluations, and in some cases the same calculation tools our evaluators created for their evaluation of the DR program. 9:57 a.m.-Residential Programs – Billie McWinn Billie presented the annual savings by program. She compared the savings and participation from 2020 to 2021 and stated that the reduction in year-over-year savings was mostly due to lighting and that COVID had very little impact on overall residential portfolio savings. Billie provided an answer to an EEAG member’s question from the November meeting about how the company handles code changes in relation to the Residential New Construction program. She shared that residential code updates went into effect in 2021. Program parameters and savings didn't change immediately to allow for homes that were already in the program pipeline. Program changes were implemented for projects rated after August of 2021, and builders were given ample notice. One member mentioned it would be good to see when this program is next evaluated and what builders did differently under the new code versus the old. Quentin reindicated an impact evaluation for the residential new construction program is planned for 2023. A member said builders don't see the savings, but it would be good to share that with the buyer. Billie responded that builders now receive a certificate for their participation in the program and the home gets a sticker showing the home was built more efficiently than code. One member mentioned that many homes are being built, and a bill is being proposed to set energy conservation codes back to 2018 levels. Still, there is not enough demand from consumers for energy efficient homes. The member questioned what the company can do to educate the buyer to demand a more efficient home. Billie provided a Multifamily Savings Program update and reminded EEAG that the company would be holding virtual meetings to discuss cost-effectiveness options going forward, and that EEAG members were invited to attend. Billie provided a lighting update, highlighting the new buydown program that was launched in late December 2021. One member asked if the program was reaching corner stores like dollar stores, as low-income customers are being pushed to dollar stores where incandescent bulbs are sold. Billie responded that grocery and corner stores would be eligible for bulbs and fixtures. Billie provided an update that in 2022 Welcome Kits will consist of four LED bulbs at 11 lumen/watt, and two LED night light fixtures. Billie presented a proposed plan to end the Energy House Calls (EHC) program and move the cost-effective measure – duct sealing – into the Heating and Cooling Efficiency (HCE) program. Though manufactured homes aren't eligible in HCE currently, the company plans to open the eligibility up to manufactured homes in order to transition the duct sealing measure from EHC to HCE mid-year 2022. One member questioned if there were potential savings for single and multi-family. Billie responded that the duct sealing measure is available for other home types through HCE. One member added that allowing the duct sealing measure in the HCE program was good but concerned that low-income customers have a more challenging time coming up with the out-of-pocket costs to participate. Billie gave an overview of the Idaho WAQC program carry-over balance. She shared the company had explored the mitigation options that were brought up at the last meeting and highlighted the company’s plan to focus on re-weatherizing homes that were less than 14 years old, in order to replace old HVAC systems with heat pumps. There was additional discussion about the 85/15 split, ideas to create a pipeline for HP installers, and questions about the need to put an end date of 2025 on the proposal. 11:14 a.m. Break 11:20 a.m.-Meeting Reconvened – C&I&I Programs – Chellie Jensen Chellie presented the top ten highlights for the 2021 Year in Review, including program updates, savings, milestones, and staff changes. Chellie is excited to have Jeff, Andee, and Curtis join the Commercial, Industrial and Irrigation team. Chellie reviewed the total program savings for multiple years with a reminder of how some programs can have large swings, depending on the duration of the construction schedules and complexity of the project. The programs are on par with years prior to 2019. In 2019, retrofits and custom projects both had a big year. Looking at 2020, custom had an all-time highest savings due to a few large mega projects. Chellie went through individual program performance for New Construction, Retrofits, and Custom and highlighted historical savings and participation for each. Chellie provided an update regarding the Small Business Direct Install (SBDI) which had 591 project installs from the programs start. Chellie explained that Simplot invited the company to participate in an Energy and Sustainability Scan to support them in reaching their sustainability and energy efficiency goals. The site visit consisted of talking with personnel about equipment, operations, and improvement ideas. The company shared incentives, and future cohort participation then summarized energy-saving metrics and possible incentives to the customer. One Member commented on the energy scan. They appreciate Idaho Power's support of the activity. Chellie discussed the Commercial Energy Saving Kits, including the number of kits distributed in 2021. The new simplified kits are being finalized, and the company anticipates availability by mid-summer. Chellie provided an update on SEM Cohorts. She thanked the EEAG members for their feedback in the November meeting and mentioned that the company is in the process of designing an industrial wastewater cohort and is gauging customer interest. Chellie went through the Irrigation Efficiency program performance and highlighted historical savings and participation. One member questioned the Irrigation Menu program. They said pressure regulators seem to wear out faster than anything and mentioned the company might look at offering incentives for just the worn-out pressure regulators rather than the whole package. Quentin responded that the program had been that way in the past but when the Regional Technical Forum (RTF) reviewed the savings, they determined that the research did not support a way to keep the savings broken apart and separated for each item. 11:48 a.m. Lunch 1:02 p.m.-Meeting Reconvened – Marketing – Annie Meyer Annie presented the Marketing Overview. She discussed the fall residential campaigns which ran on all major channels. Annie then talked about the company's marketing tactics – Sweepstakes and newsletters, including promotions on social media, email, My Account, and the homepage. My Account recently re-vamped, and the company anticipates a higher visitor count. Annie points out My Account is excellent for marketing because the audience is already engaging with the company online. Pop-ups are currently for Heating/Cooling. Annie went over what is new in 2022. The company will start delving into podcast advertising as things become more digital. She discussed continuing paid segments with KTVB and the addition of seasonal bill inserts and emails with relevant tips. Looking for sponsorships with smaller colleges and other opportunities. On the Commercial/Industrial Annie discussed some changes in the irrigation efficiency print ad (bold text) and menu form updates (easier to read). The My Account pop-up ads will promote the Retrofits program. Working on case studies for the webpages as well as customer testimonials. There will be a Chambers of Commerce newsletter ad for Eastern region and Boise metro chamber mailing list. One member asked about what sponsorships for schools might look like. Annie mentioned it would be similar to College of Southern Idaho where they have a banner in the gym advertising energy efficiency. 1:15 p.m.-Wrap-up/Open Discussion – All No questions, just a comment about how the peak rewards program is coming through the Idaho Public Utility Commission. Good meeting, thanks. I think we have gotten into the routine of doing these virtual pretty well, so thanks, everyone. Great meeting. One question regarding marketing with My account popups. The website has more options of 'read more' and 'no thanks.' Do we track the clicks? Annie answered that the company tracks the clicks on the webpage. Glad to be a part of the meeting. Shoutout to the marketing team. I feel like there's good visibility out there. I feel like I see Idaho Power everywhere. Glad to be part of the backend. Thank you for the meeting today. Good information. I am looking forward to seeing a transition from suspended work and getting through the waitlists for the residential programs. Good meeting. Just a reminder that we all know EE is important, but in the big picture, we tend to hear a lot about solar or greenhouse gas. Whatever we save, we don't have to build new resources. The basis of everything is energy efficiency. I couldn't agree more with what the member just said. I appreciate the presentations everyone put together. 1:45 p.m.-Meeting Adjourned 1 Internal Use Only Energy Efficiency Advisory Group (EEAG) May 4, 2022 Present: Anna Kim – Public Utilities Commission of Oregon Alexa Sakolsky-Basquill – Office of Energy & Mineral Resources Ben Otto – Idaho Conservation League Connie Aschenbrenner – Idaho Power Diego Rivas – Northwest Energy Coalition Don Strickler – Simplot Donn English – Idaho Public Utilities Commission Kevin Keyt – Idaho Public Utilities Commission Nick Saven – Idaho Public Utilities Commission Quentin Nesbitt – Idaho Power Sid Erwin – Idaho Irrigation Pumpers Association Tina Jayaweera – Northwest Power & Conservation Council Wil Gehl – City of Boise Not Present: Evie Scrivner – Community Action Partnership Jim Hall – WaFd Bank Marissa Warren – Office of Energy & Mineral Recourses Guests and Presenters*: Alexis Freeman – Idaho Power Andee Morton – Idaho Power Andrea Simmonsen – Idaho Power Annie Meyer – Idaho Power Becky Arte Howell – Idaho Power Billie McWinn* - Idaho Power Chad Severson – Idaho Power Cassie Koerner – Boise State Chellie Jensen* - Idaho Power Curtis Willis – Idaho Power Dahl Bietz- Idaho Power Denise Humphreys – Idaho Power Eli Morris – Applied Energy Group Fuong Nguyen – Applied Energy Group Grace Wroblewski – Applied Energy Group Heide Caswell – Oregon Public Utilities Commission Jared Hansen* – Idaho Power Jim Swier – Micron Julie Rosendic – Idaho Power Kathleen Araujo – Boise State Kathy Yi* – Idaho Power Kim Herb – Oregon Public Utilities Commission Kimberly Bakalars* – Tetra Tech Krista West – Idaho Power Laura Conilogue – Idaho Dep of Commerce Mark Bergum* – Tetra Tech Melissa Thom* – Idaho Power Michelle Toney – Idaho Power Mindi Shodeen – Idaho Power Neil Grigsby* – AEG Quentin Nesbitt* – Idaho Power Ray Short – Idaho Power Robert Ferguson – Verizon Rosemary Curtin – Facilitator Shelley Martin – Idaho Power Stephanie Wicks – St. Lukes (SLHS) Theresa Drake – Idaho Power Todd Greenwell – Idaho Power Zack Thompson – Idaho Power Note Takers: Michelle Toney (Idaho Power) with Kathy Yi (Idaho Power) 2 Internal Use Only Meeting Facilitator: Rosemary Curtin Virtual Webex Meeting Convened at 9:32 a.m. Rosemary opened the meeting. There were no questions or comments on the February meeting notes. 9:35 a.m. Announcements Quentin went over agenda, who will present, and presentations subject matter. Quentin highlighted the company filed annual DSM report with IPUC and OPUC on March 15th. Also, since the last meeting, the company received approval from both IPUC and OPUC on changes to the Demand Response programs. 9:43 AM-2021 Financials & Savings – Quentin Nesbitt Quentin provided preliminary first Quarter financials and savings (Jan-March). Advised the NEEA evaluation is part of the IPUC 2021 prudence order, and the company is working with Avista. Quentin went over the Evaluation Schedule for all program evaluations. 9:49 AM-Residential End Use Study – Kathy Yi Kathy presented the End Use Study: a self-reported survey to better understand residential customers and their usage by profiling various characteristics. Kathy presented high-level results and talked about survey responses. She noted the study results are utilized for the energy efficiency potential study. One member said, one problem with all surveys, there is a bias demographic (higher income) that is more inclined to respond than others. Does the company’s vendor do anything to mitigate that? Kathy responded that the company sent population and census data to vendor. The company has past survey results to see if trends are in line with what we’ve seen in the past. The member said, it’s good you use census as a data point. Any differences between mail and email? Kathy responded there is no difference - no bias. Vendor keeping an eye on it. Survey is not opinion based, helps reduce bias a little. One member asked, if the resistance heating is referencing electric resistant furnace or zonal? It was confirmed that it includes electric central furnace, baseboard, ceiling cables, wall heaters and radiant heat. One member asked if we compared customers that use a heat pump for heat and those that had a heat pump for cooling. Is there a good correlation there? It was followed up that electric resistance heating is defined as electric resistance central furnace, baseboards, ceiling cables, wall heaters, and other electric zonal units. A member is wondering if a central furnace is gas or electric? Kathy responded it can be broken to that detail. The member then asked if there’s a difference between stove or fireplace? Kathy explained that it depends if supplemental natural gas is used. Another member said, I lived in a home for a long time with two pellet stoves. How prevalent is that? It’s not the same as climate zone or market. Where would it fall within these definitions? Kathy said because this is a self-reported survey, the fuel type is up to the person to choose. The member said it could potentially be listed as a stove or fireplace. Kathy reminded everyone the survey questions referenced, “What Fuel” and “What System.” 3 Internal Use Only 10:27 AM-Residential Programs – Billie McWinn Billie presented residential program specific updates, participation, and savings. She explained program impacts, supply chain constraints, and increased costs. Billie shared that the Energy House Calls program is no longer cost-effective and the company has a transition plan (the program will end). Billie also discussed Multi-Family and reminded everyone that the cost-effectiveness has a bleak outlook, and that the company is looking at other ways to offer energy efficiency measures to the multi-family sector. Billie reviewed the WAQC budget carry over plan to file with the commission to adjust program rules. Billie presented BRIO updates. She explained the details of the two ductless heat pumps campaigns, and customer outreach. Billie then showed an example letter sent out to customers then provided an update on the potential Marketplace programs noting that the company and vendor are still in negotiations. One member asked about the supply chain with regards to Welcome Kits. Billie commented that the cost of materials has gone up and the Program Specialist added that product has been held in port longer than expected. One member encourages the company to engage with the RTF if there are new measures for the multi-family program. It’s important to put in a request with the RTF for those measures. 10:53 AM-Break 5 mins 11:05 AM-Marketing – Melissa Thom Melissa introduced Julie Rosandick Marketing Specialist who is replacing Tracey Burtch. Melissa presented the residential spring marketing campaigns. She discussed the company is using all major channels, new platforms, and target markets. Melissa presented the June Connections, showcasing an energy efficiency success story shared by a local Twin Falls couple. The annual energy efficiency guide goes out in June, and each of the demand response programs marketing materials have been updated. Melissa said the energy@work newsletter highlights the Irrigation Peak Rewards and Flex Peak programs. There were no questions. 11:10 PM-C&I&I Programs – Chellie Jensen Chellie introduced new Program Specialists, Ray Short & Jonathan Guynes and presented an update on activities the company is doing to promote the DR programs. Chellie provided an update on enrollment for Flex Peak and for Irrigation Peak Rewards. One member asked about repeat customers in the Flex Peak program. What are the changes and impact particulars? Chellie answered there are 134-136 participants. Some leave, some drop off. We did receive some inquiries from new customers. We are about where we've been in the past few years, but we are trying to get a higher enrollment. Another member commented that shifting the timing to later during the day and extending the season – going to Sept 15th. The member is concerned about those unable to or won’t participate. Said the numbers are good for reenrollment but will have to see how it plays out this year. The member said that it looks like numbers are really close to where we've been, and this is encouraging. Chellie said we're excited to see the results as we get near June 15th. One member asked about when the enrollment ends. Chellie said we asked that enrollment goes through June 15th. We want resources in place. Ag Reps are calling those who haven’t got their enrollment papers in. What we're seeing is normal for this time of the year. 4 Internal Use Only Chellie presented the first Quarter program performance for Commercial, Industrial and Irrigation Programs. She compared each program to the total projects and savings since 2013 and discussed supply chain issues. She discussed the company’s ideas and recommendations to address participation issues and asked for ideas from EEAG. One member asked about the difference between SBDI and Retrofits. Chellie explained that SBDI is aimed at small businesses that use 24,999kWh or less per year. The contractor targets customers in this range, performs an assessment, then changes out the lights on site. Customers don’t have to go out and get bids, it is at no cost for the assessment and the installation for the target customer such as small mom & pops. It’s a win-win for them and they are not spending extra time to learn the “art of possible.” Retrofits are primarily marketed by trade allies. There’s a lighting tool used and customers or trade allies indicate the existing and the proposed fixtures and the project cost and the incentive is populated. The potential exists that some measures could get up to 100% of the project cost, and is based on savings and equipment. Very simple, but SBDI is mostly a lighting concierge service for the smallest of our customer base. Chellie highlighted Micron’s Earth Day celebration and the history between Micron and the company. A Micron representative spoke about their appreciation for the company’s support and the great collaborative effort. The representative said Micron has been in the area for more than 40 years. They have a good budget to upgrade equipment and doing lots of remodeling to old buildings to replace old systems. Micron does have supply chain issues. It takes 15 to 30 weeks to get larger equipment. They are putting in orders much earlier than normal, due to long lead times. The representative said Micron is participating with Flex Peak, but their overall loads are just so big sometimes it doesn’t show. Chellie also highlighted the City of Boise street lighting project that will be completed in September 2023. She discussed the benefits of LEDs, the MWh per year saved, safety, and the controls technology. A representative of the City of Boise is excited to partner with Idaho Power. Residents have been liking the changes. The City of Boise is looking forward to getting the project completed. They are looking into DR programs as well. They appreciate the company meeting them at City Hall to do the check presentation. 11:50 PM-Lunch Break 1:06 PM-Meeting Reconvened Rosemary and Quentin Per Quentin’s request, Rosemary introduced those who joined after lunch and that IRPAC members were specifically invited to this portion of the meeting. 1:10 PM-T&D Benefits – Jared Hansen Jared presented T&D Benefits starting with the deferral methodology explaining what makes up the energy efficiency value. He gave a T&D deferral example showing energy efficiency measures can bring down anticipated high demand that is triggering upgrades before the peak. Jared discussed the old methodology through the IRP time frame. He demonstrated the life span of an energy efficiency measure and went over the company’s approach, deferral value, and iterative process. One member said while the NWPCC council methodology is slightly different, the numbers are close to what they got. The member asked if the company is discounting over 20 years. Jared said all project costs are adjusted to current dollars and the savings occur for the deferral in the project start. 5 Internal Use Only Another member questioned, depending on the savings in question, in a world with supply chain issues and inflation, would those factors persist here (do those factors impact this analysis). Jared replied that some of the forecast period is in the supply chain issue timeframe. But impacts are built into those near-term years. The member asked if a transformer cost $800,000 and there is a 2% annual inflation, is that put into any of the savings at risk? Jared said we calibrated cost of capital and used an inflation rate that was a composite of a number of years. Not as drastic as what we're seeing right now because the analysis is a longer-term look. The member questioned if T&D values are represented together is it a composite of two different numbers, or can T&D be broken out, are they calculated the same? Jared answered that they are separate numbers. Three categories (called T&D deferral) are substation, transmission, and distribution deferral. Most savings from T&D are from the distribution side. Transmission is more difficult to defer. Not as many projects and harder to quantify. One member asked if you look at energy efficiency forecasts, is it always a load reduction or shifting? Jared said that energy efficiency measures are load decreasing. With DR, we see more of a shift. We do separate out load reduction and energy efficiency reduction. The member said in instances you’re trying to defer that installation of substation. Is there a way to account the risk of future growth that otherwise would be a greenfield opportunity and increase installation cost? Jared answered that there are risks like the one you mentioned. We didn't attempt to quantify for those in this analysis. The member inquired about load shifting. Anticipating same approach if demand was shifted instead of reduction, how would you compensate a surprising alteration potential that creates another challenge for the network (would the company use a similar approach if looking at load shifting through demand response)? Jared said it could because the company tends to give attention to local peak need (DR) versus targeted system need and there could be consequences. Not part of the scope of what we’re doing here. Another member asked, are you proposing this in the 2023 IRP as current method? Jared replied that $6.73 is an input to the potential study that will be presented after today. Energy efficiency forecast is a decrement in load we must meet. The member said it seems like a big change from the previous methodology. Is there a reason we're now doing this instead of before? Jared said one member pushed him toward this before and was right. At the time, it was just a methodology change we didn't implement until this year. We didn't know the impact of the change. All this feeds into the IRP. That is why an invite was sent to IRPAC as well, to determine the needs on the system. Yes, we would be proposing the T&D deferral value would affect the IRP. The member asked, will you also be presenting this change to IRPAC? Jared answered that he is not planning on presenting but welcomes feedback. The member will follow up. 1:33 PM-Energy Efficiency Potential Study Introduction – Quentin Nesbit Quentin introduced the two topics the Applied Energy Group (AEG) will be presenting. He went over the timeline and the purpose of the energy efficiency potential study. There were no questions. 1:38 PM-Energy Efficiency Potential Study – AEG – Neil Grigsby, Eli Morris, & Fuong Nguyen Neil introduced the Applied Energy Group (AEG) and the team presenting. He presented the study objectives and noted that numbers shown are draft numbers for potential savings, and that the commercial, irrigation, and industrial are close and that they are still working on residential. Eli presented the AEG’s methodology, showing data collections and gave an overview of their modeling approach. One member commented that for the 2021 power plan, they are moving away from calculating achievable potential as a max of 85% of economic potential. Are you using that assumption in this analysis? Fuong answered 6 Internal Use Only that achievability is based upon measure level. We have incorporated the 2021 power plan updates. Some achievable rates may be larger for measures in which increased standards a present and would hope to get near 100% of the economic potential as achievable potential. Another member asks, did you do any different analysis based on change in building code? Our code is lower than others around us. Eli replied, we didn’t model what the code would look like. We model the current building code. We don't speculate on what a new building code would look like. Councils’ achievability assumptions do include some information on this, but we don't forecast codes or understand what things would look like if there were potential new code changes. If a code is improved, it would reduce savings, but it is not included in this study. 2:02 PM-Demand Response (DR) – Quentin Nesbitt Quentin presented the introduction to the Demand Response Potential Study. He went over the timeline for the completion of the study and how will fit into IRP timeline. Quentin briefly described the company’s DR programs. He reviewed the history and discussed the modifications recently approved by both commissions. 2:11 PM-Demand Response Potential Study – AEG – Maggie Buffum Maggie presented AEG’s approach to the DR potential study and mentioned they will be starting with the NWPCC DR assessment assumptions. She explained overall approach and noted the study will be specific to the company’s service territory taking into account that the Idaho Power is summer peaking which is different than the rest of the NWPCC region. Therefore, it’s necessary to review and modify some of the council’s assumptions. She shared council assumptions on DR resource and costs. One member commented that in the 2021 IRP, the company limited DR to 20 MW additions. Will that occur in the 2023 IRP? Quentin answered that we have not yet determined how the possible capacity additions will be modeled. We will see what the potential study shows and make some judgement calls on how to grow the programs or add potential programs. There will be some assumptions with ramp rates that could replace the '20 MW rule’ that we put in place in the 2021 IRP. Another member commented about not seeing DVR on this. Was it included as part of the study? Eli answered that it wasn’t because it is not a demand side program. Maggie said they planned to look at only things on the customer side of the meter. Quentin added we have been testing and piloting DVR. The member added that there is value with DVR and recommends the company keep exploring opportunities. One member asked if A/C load control and bring your own thermostat are two separate programs? Quentin answered it’s something we have contemplated in past. There are some issues with overlap and switches being abandoned going to thermostats. This impacts overall cost effectiveness. I anticipate if we add thermostats, we will try to keep it under the A/C Cool Credit umbrella. We do believe there are substantial differences in how the programs run and the results you get between the two. AEG will be evaluating overlap, technical, and customer issues. The member then asked what is your AMI situation for your customers? Quentin answered over 99% of customers have AMI hourly interval data. The member said it helps when you think about cost. Quentin replied that is correct. One member had a comment geared towards Jared. One of the things we worked really hard on is to account for the interaction of energy efficiency and demand response in the total NWPCC plan. Have we thought about how to do this here? Smart thermostats are an energy efficiency measure but has demand response potential as well. Heat pump water heaters as well. Getting this integration was difficult and it was not necessarily done perfectly. How are we trying to think about this? Jerad said the brief answer is we need to continue thinking about this. Energy efficiency will reduce demand in the plan. Demand response will be able to act as it naturally would for the most part. It will be built into the IRP. The member said they will follow up later with Jared. 7 Internal Use Only Another member has a question about irrigation. Seeing patterns of climate change and drought, how would this impact demand response? Will it impact irrigators when temperatures are high where they would be unwilling or unable to reduce water use? Quentin said drought is something that irrigators certainly have delt with. It’s not that uncommon. If farmers don’t have much water, they will change crops and grow something different. That can impact our program especially later in the year. Quentin also noted that if irrigation load is down, the system load will be down as well, and there will be less potential need for DR. 2:34 PM-Break 10 mins 2:41 PM-Customer Evaluations – Tetra Tech Kimberly Bakalars & Mark Bergum Quentin introduced Kimberly and Mark. Kimberly presented the evaluation of 2020 custom projects for commercial and industrial efficiency program. She discussed the difference between impact and process focus then provided some background information. Kimberly went over the methodology objectives along with a follow up from previous evaluations. She reviewed impact and process steps and said the company does a great job with communicating to customers and documenting the program, resulting in good relationships. This also adds to the company’s high satisfaction ratings. She also noted that customers appreciate the company’s staff, and commented customers noted that incentive estimates were close to the actual final incentives. Mark presented the impact results and recommendations stating the importance of maintaining long-term focus on cohort projects. He discussed sophisticated systems-based energy efficiency is delivered above the standard equipment improvements. He noted projects implemented with the support of the company’s programs may not have occurred otherwise because customers would likely be unable to design the improvements, coordinate efforts of installation and operation and obtain engineering calculations of savings without the support from the program. Mark provided the recommendation that a consumption analysis approach for savings could be something the company look at. In his opinion the approach could provide energy savings from projects without complicated engineering reports to determine the impact of each project. There were no questions or comments. 3:15 PM-Wrap-up/Open Discussion Rosemary asked each member if there were any questions or comments. Very informative thank you. No thanks. Rosemary great meeting I enjoyed everything. Amazing to see the progress over the years. Good meeting. As far as Tech Tetra, I’ll echo everything said about IPC building relationships and being trusted. It is crucial. Our incentives are about what we expect them to be and fosters our future participation. Eco industrial. One idea: we have goals for energy, water, and carbon reduction. Might it be worth figuring out metric tons co2 equivalent was also avoided with that energy savings. Thanks very much no questions / comments. I will echo the members thoughts on program. I think you should track the co2 equivalent. For us, it was 44,000 metric tons of co2 that was avoided in our number. Look forward to seeing results from DR potential study and how it will impact 2023 IRP. Interested to see 2022 summer performance for demand response programs. I really liked today’s meeting and the presentations. The guests and presenters did great. Thank you. 8 Internal Use Only Rosemary reminded everyone that the next meeting is Thursday, August 11th at 9:30 A.M. 3:30 PM-Adjourn Energy Efficiency Advisory Group (EEAG) August 11, 2022 Present: Not Present: Jim Hall – WaFd Bank Marissa Warren – Office of Energy & Mineral Recourses Guests and Presenters*: Andrea Simmonsen – Idaho Power Annie Meyer* – Idaho Power Becky Arte Howell – Idaho Power Billie McWinn* - Idaho Power Chad Severson – Idaho Power Chad Ihrig – Google Nest Chellie Jensen* - Idaho Power Curtis Willis – Idaho Power Dahl Bietz- Idaho Power Denise Humphreys – Idaho Power Gavin Hamilton – Idaho Power Jeff Rigby* – Idaho Power Julie Rosandick – Idaho Power Kathy Yi* – Idaho Power Kevin Kitz – KitzWorks Llc Melissa Thom – Idaho Power Michelle Toney – Idaho Power Mindi Shodeen – Idaho Power Ray Short – Idaho Power Rosemary Curtin – Facilitator Shelley Martin – Idaho Power Theresa Drake – Idaho Power Tracey Burtch* – Idaho Power Todd Greenwell – Idaho Power Tracey Burtch* – Idaho Power Zack Thompson – Idaho Power Alexa Bouvier – Office of Energy & Mineral Resources Aly Bean – Idaho Conservation League Anna Kim – Public Utility Commission of Oregon Connie Aschenbrenner – Idaho Power Diego Rivas – Northwest Energy Coalition Don Strickler – Simplot Donn English – Idaho Public Utilities Commission Evie Scrivner – Community Action Partnership Jason Talford – Idaho Public Utilities Commission Laura Conilogue – Idaho Public Utilities Commission Nick Sayen –Public Utility Commission of Oregon Quentin Nesbitt – Idaho Power Sid Erwin – Idaho Irrigation Pumpers Association Taylor Thomas – Idaho Public Utilities Commission Tina Jayaweera – Northwest Power & Conservation Council Wil Gehl – City of Boise Note Takers: Michelle Toney and Kathy Yi – Idaho Power Meeting Facilitator: Rosemary Curtin Virtual Webex Meeting Convened at 9:32 a.m. Rosemary convened the meeting and led introductions. 9:37 AM-Announcements Quentin reviewed the agenda. There were no questions or comments about the May 2022 meeting notes or the August agenda. 9:40 AM-2022 Financials & Savings – Quentin Nesbitt Quentin presented DSM savings and costs by sector and program from January through June 2022. He also provided an overview of the program evaluation schedule. In addition, Quentin mentioned the company has sent out an RFP for selecting contractors for the 2023 evaluations. One member had a question about the “Other Evaluation” category specifically mentioning the DR programs and whether the company is doing Impact Evaluations. Quentin said DR evaluations are done every year and include the impact of the program and that the reports are included in Appendix 2 of the annual DSM report. The “Other Category” is to indicate it wasn’t done by a third party. 9:55 AM-Cost Effectiveness – Kathy Yi Kathy presented the DSM program’s cost-effectiveness (by sector) with a deeper dive on some specific programs. She provided an update on the Heating & Cooling Efficiency (HCE), and a refresher on how lower savings for Ductless and Air Source Heat Pumps (HP) are impacting the programs cost-effectiveness. Kathy reviewed the new 2023 federal standard for Air Source HPs and impacts on the program, then went over the company’s next steps. She discussed the changes in lighting and the impacts to efficiency potential due to the Energy Independence and Security Act (EISA) and the Department of Energy’s (DOE) 2019 final rule. Discussion and Questions: Small Business Direct Install (SBDI) program One member asked about what makes SBDI more cost-effective from the Total Resource Cost (TRC) perspective and specifically why the benefit is higher under that test. Kathy said the TRC includes an additional 10% conservation benefit as well as non-energy benefits. The member then asked if Idaho Power is expecting SBDI to be borderline cost-effective because of increased costs and whether we expect higher savings due to the larger population of small businesses in the treasure valley, mentioning that is seems the economies of scale would improve with larger populations. Kathy said it’s hard to predict, but that cost effectiveness is more affected by the type of lights being replaced more than the total overall number. Another member questioned if it’s possible to continue the SBDI program because small business is a class of customers that are harder to reach. Getting guaranteed savings with direct installs is a huge benefit. Quentin commented that this program was designed to roll across the service area before March 2023. All small business customers have had at least one chance to participate. One member asked about the SBDI details including the top three costs that rose faster than expected and identify then breakdown a few problematic areas. Kathy said she doesn’t have the specific breakdown of costs. Quentin said that we contract with a third-party vendor therefore, we don't see the specific costs, but they are saying they're experiencing cost issues and will not be able to renew the contract at the current price. Another member asked what the average cost of an SBDI install is. Kathy answered that she’s only looked at the total numbers and hasn’t looked at the per-project numbers yet. Residential Heating & Cooling Efficiency One member said the RTF found HPs installation practices are very impactful on savings. Some are installed in homes with gas heat, to supplement cooling, which results in low or negative savings. It seems the company requires the minimum HSPF standard for air source HPs for an incentive. Kathy said this is correct and electric heat is required and the incentive is based on the higher HSPF. The new standards change the baseline, so we claim less savings. Another member stated they see this as a factor in the C&I space as well. A guest asked if the company would consider smart thermostats in conjunction with a hybrid heat pump with gas backup system. Billie proposed the Program Specialist and guest connect outside the EEAG forum for a detailed discussion about program strategies for HPs and smart thermostats. Lighting One member asked about the programs affected by the EISA, when the contract with the lighting vendor ends, and whether the types of bulbs can be updated mid-contract. Kathy said our current residential lighting by down ends this year and added that Chellie would present on some commercial program impacts also. There was a question about if the savings is higher with LED fixtures versus a screw-in LED. Kathy answered that the company does have fixtures in the programs, but it is an area that isn’t fully transformed yet. We could potentially offer incentives but if we don’t have a specific Buy-Down program, it could impact how we can offer an incentive. We may be able to offer incentives through the new Marketplace Program. 10:40 AM-Break 10 mins 10:50 AM-Residential Programs – Billie McWinn Billie presented an overview of the programs in terms of savings and participation, noting she will be seeking feedback for the Lighting Buy-Down program. Billie then showed program updates on Multifamily Savings, Welcome Kits, Lighting Buy-Down, Home Energy Reports (HER), AC Cool Credit DR program (ACCC), and the Marketplace. Discussion & Questions: Welcome Kits One member asked if the company could include thermostatic shower valves (TSV) in the Welcome Kits. Billie said the kits go to all customers and the savings from TSVs can only be claimed if the customer has an electric water heater. Denise added TSVs are expensive. Another question was if there is anything in the student kits that could be incorporated. Denise provided an overview of the kit’s contents and said the savings are minimal, but we are exploring ideas with the vendor. Another member asked if the energy efficiency tips can be added to the kits. Denise said the education flip book includes that information, and the book is updated annually to reflect any program or other changes. One member had a question about the packaging being adjusted for kits in 2023. Denise responded that the box is going to change but that does not reduce the shipping costs. We are exploring options for other shippers at a lower cost. Another member asked if the company tracks the participation in other energy savings programs from customers that receive Welcome Kits. Billie said we don’t have direct tracking in place. The member asked if there was a follow-up survey about possible changes in usage. Denise said new customers wouldn’t see that change because there is no comparison of historic bills. Lighting Buy-Down One member questioned if the Buy-Down Program is cost-effective. Billie said yes. The member pointed out a clean break at the end of 2022 may be more straightforward because while there are potential saving opportunities into 2023, it could get messy in terms of evaluating the programs cost effectiveness. Another member commented, retailers may try to exhaust their inventory of cheaper inefficient bulbs, it makes sense to try to counteract that and continue the program into 2023. Perhaps reducing the Buy-Down amount could potentially give the lower income customers a glide path to help with the higher cost without the buydown. There was another question about other utilities or co-ops in Idaho and where they are targeting lighting incentives beyond 2022. Billie said our vendor does run other programs in the region and we engage with them. Another member said that if the Buy-Down Program is cost-effective, they would prefer continuing it into 2023, because in rural areas, there are smaller businesses and high inflation over the past several months. HER Program One member said they received their HER report and asked if changes in weather are accounted for in the savings. Denise said comparisons are from the same area that experience the same weather. Another member asked if the HER is an opt-out program, and whether there has been a decline in participation. Billie confirmed it is an opt-out program and affirmed that participation decreases over time is due to attrition. The member asked if there’s an attempt to backfill those participants. Billie said the treatment and control groups must start at the same point to be able to make a comparison. Denise added, at the start of the program, all residential customers with adequate meter history were included in the participant pool. The company continues to monitor customer eligibility, but currently, there’s not enough residential customers meeting the criteria to create a new treatment and control group. AC Cool Credit DR program One member asked if Idaho Power is considering a Bring-Your-Own Thermostat (BYOT) program. Billie said we are monitoring that. The member also asked if the company would stop using the switch if it added a BYOT program. Billie advised no, because the current switch option is a cost that is already invested. Billie also added that a BYOT program would require a considerable investment in the control interface for our load-serving operations. Another member asked about the cost per switch and the current Smart Thermostat incentive. The company responded that the cost of the switch is $165, which is based on buying in volume, and the Idaho Power incentive for a Smart Thermostat in the H&C Efficiency program is $75. Marketplace One member asked about how local smaller retailers participate in Marketplace. Mindi said the Marketplace tool can provide a list of the local stores that carry the product. However, retailers that want to list what their daily price for products are, would need to provide a file of all product model numbers and prices daily. 11:35 AM-Marketing – Annie Meyer Annie provided marketing updates for all sectors highlighting residential A/C Cool Credit, smart summer contest, EE awareness campaigns, and commercial and industrial EE incentives. One member suggested the Marketplace timing to be up and running prior to Black Friday/Cyber Monday/holiday season and mentioned Idaho Power could leverage those retailer/OEM promotions. Melissa responded yes, that is our hope to get it going by then. 12:00 PM-Lunch Break 1 HR 1:00 PM-My Account – Tracey Burtch Tracey’s presentation covered the My Account default view for homes and businesses, showing daily use with temperatures and how to use the features. She also demonstrated the ease of adding information to the home profile and the information and tips My Account will provide in the savings center. Tracey then showed how customers could sign up for alerts. There were no questions or comments. 1:12 PM-C&I&I Programs – Chellie Jensen Chellie provided year-to-date savings and participation for the commercial, industrial, and irrigation programs. She also highlighted the 2022 DR participation compared to 2021 and showed the event days so far this season. Discussion & Questions: Irrigation Program One member wanted to know what drove the program reduction in participation. Chellie said Ag Reps found many reasons for the change in participation, but we expect to know more post-season. The member added, there was a higher loss of MW than sites. Chellie said we did lose large MW participants but gained a lot of smaller ones. Quentin added the reduction in participation was related to the impact of the program changes. Energy Efficiency Savings One member asked if there is a good pipeline of projects for the programs. Chellie said we have a good pipeline for Custom Projects, not as good for Retrofits and pretty good for New Construction. For the New Construction program, it’s been difficult to get architects and engineers to engage. There is a lumpiness in savings, but if you look at the second half of last year, it's the same rate of savings as the first half of this year. It doesn’t look like we’ll get to 2021 total savings level, but we could get a few large projects in 2022 that would change things. Another member inquired if the 2022 numbers should be read as YTD or only Q2. Chellie said the numbers reflect the first half of the year (YTD). Commercial Savings Kits One member asked about the measure life on the LEDs. Kathy said this was the estimate of how long the previous life would last. She explained how the company settled on the savings claimed and added that a third-party is currently evaluating. The member inquired about the exit signs and aerators. Kathy said they have different measure lives. 2:00 PM-Engaging With C&I Customers – Jeff Rigby Jeff discussed the company’s engagement with large power customers through the company’s Key Account Energy Advisors (KAEA). He presented the number of Idaho Power KAEAs, their role, the type of support they provide, and how they help find opportunities for energy efficiency and to influence customer participation in the company’s energy efficiency programs. Jeff also gave examples of EE projects that KAEAs helped with. Discussion & Questions: One member asked if the company has Tribal Governments or Reservations in the service area and would those be considered Key Accounts. Jeff said we have one in the Pocatello area, but to be a Key Account, and have an assigned KAEA, depends on if the business falls into the 1 MW or greater demand. The member added, is there any specialized outreach to those entities that might be harder to get involved in these programs. Jeff said that we are consistent across the board with our Key Accounts, but we could be missing other program opportunities. Connie added, we do have a lot of engagement with our cities and have a team who maintains those close relationships. The member stated the question is more about the tribal territories than cities. Connie added that we do have engagement with local tribal communities. 2:25 PM-Wrap-up/Open Discussion – All Rosemary reminded the group that the next EEAG meeting was November 17th. Quentin provided an update on some of the responses from the members regarding meeting preference (in person or virtual) but would like to hear from the rest of the group. Rosemary then gave each member an opportunity to ask questions or to make their final comments. Members comments: Appreciate it today. All the discussions and responses to my questions. Nothing to add, but thanks for everybody’s time. No final questions. Thank you for entertaining my questions that I had. No additional comments for me. Thank you for the informative and enjoyable meeting. I appreciate it. Thanks everyone. No final questions. Just know it's challenging times and I appreciate everybody working hard and trying to get through it and moving forward. So, thank you. I do want to thank you for the presentations today. Very informative and some changes going on due to the lighting. Appreciate active management. Thank you. I believe you answered all my questions. It was very informative, and you were specific about everything. Quentin added that he very much appreciates the time each member takes out of their day to help us. 3:00 PM-Adjourn Energy Efficiency Advisory Group (EEAG) November 17, 2022 Present Not Present: Anna Kim – Public Utility Commission of Oregon Donn English – Idaho Public Utilities Commission Marissa Warren – Office of Energy & Mineral Resources Guests and Presenters*: Andrea Simmonsen – Idaho Power Annie Meyer – Idaho Power Becky Arte Howell – Idaho Power Billie McWinn* - Idaho Power Chellie Jensen* - Idaho Power Curtis Willis – Idaho Power Dahl Bietz – Idaho Power Denise Humphreys – Idaho Power Eli Morris – Applied Energy Group Eric Shierman - PUC of Oregon Jason Talford – Idaho Public Utilities Commission Jared Hansen – Idaho Power Jeff Rigby – Idaho Power Jordan Prassinos – Idaho Power Julie Rosandick* – Idaho Power Kathy Yi* – Idaho Power Kevin Keyt – Idaho Public Utilities Commission Kimberly Loskot – Idaho Public Utilities Commission Krista West – Idaho Power Laura Conilogue – Idaho Public Utilities Commission Landon Barber – Idaho Power Maggie Buffum – Applied Energy Group Michelle Toney – Idaho Power Mindi Shodeen – Idaho Power Nathan Black – Idaho Power Nick Sayen –Public Utility Commission of Oregon Rosemary Curtin – Facilitator Shelley Martin – Idaho Power Theresa Drake – Idaho Power Todd Greenwell – Idaho Power Zack Thompson – Idaho Power Note Takers: Michelle Toney and Kathy Yi – Idaho Power Meeting Facilitator: Rosemary Curtin Virtual Webex Meeting Convened at 9:33 a.m. Rosemary convened the meeting and led introductions. 9:35 AM-Announcements Quentin went over the agenda. There were no questions or comments about the August 2022 meeting notes or the November agenda. He introduced the newest member to EEAG, Brad Heusinkveld (representing ICL). Quentin added the February 2023 meeting will likely be in person and that the plan for the remaining 2023 meetings will be virtual. Connie shared that the IPUC approved the prudence request for 2021 expenses and acknowledged the EEAG contributions to the success of Idaho Power’s programs. 9:40 AM-2022 Financials & Savings – Quentin Nesbitt Quentin presented the DSM savings and costs by sector and program from January through September 2022. He also provided an overview of the program evaluation plans and specific evaluations to be done in 2023 then asked for any feedback. Questions & Comments: One member asked if the company is going to separate out expenses from the carryover funding for HVAC systems from normal WAQC expenses in our reporting, noting it would be helpful for those to be separated out. Billie said those costs will be broken out in the annual report. 9:52 AM-Cost Effectiveness – Kathy Yi Kathy presented the DSM program’s cost-effectiveness (by sector) with a deeper dive on some specific programs. Kathy went into detail on Commercial Energy Saving Kits (ESK) and discussed several anticipated changes to the savings assumptions in programs such as Green Motors Rewinds, Heating & Cooling Efficiency, Shade Tree, and Weatherization programs. Kathy presented the Energy Independence & Security Act (EISA) timeline and standards then highlighted those programs that would be affected by EISA with a deeper dive on Student Kits and C&I Retrofits. Discussion and Questions: Lighting One member asked if one of the purposes of evaluations is to compare measure weightings to the Technical Reference Manual (TRM) and whether those weightings are adjusted after the evaluation. Kathy said the evaluators do check the TRM numbers but she’s unsure if they check the underlying weightings. Kathy indicated she would follow up directly after the meeting. Kathy followed up with the member through email after the meeting saying that the weightings for YTD numbers show some building types of weights are close to what we currently have in the TRM (retail and office for example), and other building types seem off (manufacturing and schools for example) and could still be experiencing lingering impacts from COVID. Also noting weightings mostly impact the HVAC measures and we don’t have many HVAC projects that come through, most projects are lighting which is a straightforward calculation. She also noted that rechecking the weightings with multiple years of data to absorb and any COVID impacts will be on our to-do list when we update the TRM or have our next program evaluation. Avoided Costs One member asked how avoided costs are decreasing despite a recent filing showing increasing forecast prices for natural gas. Kathy said she is not familiar with the filing, but avoided costs are based on the company’s Integrated Resource Plan (IRP) and forecasted gas prices are part of the avoided costs. She added that it is important not to make program changes too quick, however, if a program is not cost-effective for a particular year, then the company might factor in other considerations. Quentin added it is the company’s practice to use acknowledged IRPs and if we see a program not cost-effective but know an update will increase the avoided costs, we will consider that before we make changes. There was a question about the major driver of the avoided costs flattening out in the IRP. Quentin explained that the high-level reason is the impact of renewable resources. Another member agreed and added that the avoided costs that Kathy presented are annualized costs, but the shorter-term costs and load shapes are starting to change with the growth of certain renewables. The member used the California Duck Curve example to demonstrate the stress on the system due to the evening ramp. EISA One member asked for clarification about the July 1st enforcement date. Kathy said enforcement is progressive, expected by July 1st, but compliance can’t be predicted. The member asked how the commercial kits will be cost-effective in 2023 compared to 2022. Kathy said she is waiting for the final result of the evaluation to determine the kit savings for 2022, but the new kit vendor had a late start with the new design and there have been fixed costs incurred this year which is why it won’t be cost-effective this year. The evaluator recommended updating the savings using survey results. This could lead to 2023 being cost-effective if future survey results show higher installation rates. Another member asked what assumptions are made for future savings and if they are strictly based on the life of the bulb. Kathy said the measure is based on the life of the bulb but because of the new standards, at some point when people replace them, they will have no choice but to get an efficient bulb anyway. Home Energy Reports One member asked about the Home Energy Reports one-year program life. Kathy explained that HERs have a one-year life because we send reports every year and claim annual savings. At some point, the program will end, and we will stop sending out reports. However, research shows that savings will continue to persist after customers stop receiving the reports. These savings are not reflected in the one- year life view. 10:35 AM-Break 10 mins 10:46 AM-Residential Programs – Billie McWinn Billie presented the overall health of the residential programs in terms of YTD savings. She discussed program impacts from EISA and the Shade Tree program changes. Discussion & Questions: There was a question about the saving goals for each year and whether the company achieved its goal in 2021. Billie said savings are broken down by program then by the sector and she is presenting only the residential portfolio. Quentin added our goals are set based on the Energy Efficiency Potential Study and the company achieved its total savings goal in 2021. Lighting Buy Down One member asked how the company knows what bulbs are in the stores. Billie said that the program specialist monitors the stores. The member suggested the company also look at the NEEA shelf study. Welcome Kits One member asked what will occur after July in the welcome kits. Billie said that we anticipate the kits will contain two lightbulbs and two nightlights but will not claim savings for the lightbulbs beyond July. Funds will be associated with the Education Initiative. Another member asked why showerheads were removed from the kits. Kathy said the welcome kits had only lighting and noted it was the Energy Saving Kits that had showerheads for customers with electric water heaters. Billie added that the company is always looking for new energy-saving widgets to include. The member added, with electrification, the company may want to look at other measures. Multifamily One member asked if the company has already started to close the Multifamily program. Billie said the program ends December 31st and the vendors have been notified. Shade Tree One member commented that the smaller trees will grow into the same size as the larger trees and asked how the company accounts for that longer measure and how will the company differentiate the lifespan of the trees (when they finish growing). Kathy said we adjusted the calculator out one year and the evaluation and audit will help us figure out what happened to those trees. She explained how contractors go out and look at the trees based on the customers program application that has a map of where the trees are located. If the trees aren’t where the customer said, the auditors go back and recalculate. They will then gather all the data and come up with the new savings. 11:00 AM-C&I&I Programs – Chellie Jensen Chellie provided year-to-date updates (preliminary) participation and savings numbers, changes, and challenges, for the commercial, industrial, and irrigation programs. Chellie discussed the Small Business Direct Install challenges, reminding EEAG that the program ends in March. She discussed the Custom Project pipeline, the Industrial Wastewater Cohort, and the Find and Fix program. She then noted that some industrial training is back in person, but we are also offering hybrid training. There were no questions or comments. 11:26 AM-Marketing – Julie Rosandick Julie provided an overview of Program Marketing, she discussed the DR thank you letters, postcards and print materials, Shade Tree, the contest results, College of Idaho signage, Fall Energy Efficiency residential campaign and the marketing campaign of “Joulie and Wattson” retiring. She showed the new Commercial ESK and Custom Projects flyers. Julie also discussed the latest Energy @Work newsletter for C&I customers. Discussion & Questions: Demand Response Marketing One member highly encourages the company to have the VP or president sign the Irrigation Peak Rewards thank you letters to show how grateful the company is for DR participation. Julie said the company will consider the request. The member asked if there will be more marketing to irrigators. Julie said we will look at other marketing ideas and would like to collaborate further outside of EEAG. Changes in Programs One member asked how the marketing materials reflect changes within the programs. Julie said the marketing materials are reviewed by each program specialist with each program change. Annie added that the Corporate Communications and Customer Relations & Energy Efficiency groups frequently meet to discuss program changes. Quentin clarified that in some situations a direct letter is sent to all potential participants, depending on the type of change and how it may affect participation. It is the company’s intent to give customers time to respond to program changes. Finally, Chellie added that on the commercial side, we also use our field staff the Key Account Energy Advisors and Energy Advisors to connect with customers directly. 11:39 AM-Lunch 1 Hour 1:00 PM-2022 DR Season Results – Billie McWinn – Chellie Jensen Billie presented the residential A/C Cool Credit Demand Response (DR) program, discussing participants, enrollment levels, and 2022 event results. Chellie presented the C&I Flex Peak and Irrigation Peak Rewards DR programs event results. Chellie highlighted some of our marketing and customer engagement on these programs. Discussion & Questions: A/C Cool Credit One member asked why the projected participation declined. Billie said this is just a predictive model from Excel looking at historical numbers. It’s purely based on the last four-year trend and not any other insight. Another member asked if the company reaches out to customers who no longer participate and find out why they opted out. Billie said the drop out number is small in comparison to the attrition due to customers moving out of homes. Generally, there are only small amounts of opt outs per event because the program tends to be one where customers sign-up and forget. When people move, they sometimes come back to the program, but that occurs most common when they move into a house with the switch already installed. She noted there are many participants who may move out of the area or into a home that may not be eligible as there are limiting factors that prevent them from participating. The member also asked if the company is considering thermostat-based rather than a switch-based program. Regarding a thermostat Program, Billie said that the company has been meeting with vendors and getting price quotes. Quentin will also cover this subject in the next presentation. Another member asked if the capacity in the program has been close to what it’s been in the past. Billie said at one point we had almost double the number of participants we have, and that program capacity is completely dependent on the number of participants we have enrolled. Irrigation One member asked how the later-hour option called Group D is broken out. Chellie said Groups A, B, and C are broken out by region. Group D is the latter option, meaning we can call events up until 11 pm which offers a higher variable incentive, so a participant could be in any region. The member then asked if the company has considered breaking out groups by crop. Quentin explained we have considered that in the past, however that can be complicated. If groups were set by crops, it would have to change every year by site (depending on what the customer planted) and it is not uncommon for one system to irrigate multiple crop types. Quentin also pointed out that it is up to the farmer to consider their crop when looking at whether to participate in the program. Another member asked about the breakdown between manual and automatic participants. Quentin responded that the number of manual customers is small, approximately 20 customers on 40 sites, however the load is a significant portion of the program at around 60MW of potential reduction. The DSM annual report will have the participation information in detail. The member asked if there are issues with manual participants. Chellie responded that they participate well and have a high realization rate during events. One member requested clarification about the minimum number of events and asked if the program is economically dispatched. Quentin said there are multiple factors considered for dispatching and market price is one but not the purpose of the program. The main purpose is peak capacity. The minimum number of events also enables the program to regularly test its capabilities. We still have a minimum of three events, but the difference is that the variable payment doesn't kick in until the fifth event. Our Load Serving Operations group ultimately decides when the program is used, however the Customer Relations and Energy Efficiency department also advises on event timing. The main purpose of the program is for when there aren’t other options for resources including the open market. Another member requested clarification about the event times for the groups and if those events would have been possible prior to the program parameter changes this year. Chellie explained many events went to 10 pm which is new, and Group D had the potential to go to 11 pm. The member then asked if the late option has sites with automatic restart switches and if we track specifically why those customers are willing to participate in the late evening hours. Quentin said we have not asked for that information, but know it is dependent on the customers willingness or ability to go out and turn their systems back on and how easy or hard it is for them to do that, so we know automation has a lot to do with it. Flex Peak One member asked about the July event that was called and then later canceled. Chellie said that this did not impact customer participation for the remainder of the season, but we are aware it can negatively affect some customers, she added that the company having the ability to cancel events is an important feature as system conditions can sometimes change quickly. One member asked if the later hours were a hurdle for the commercial/industrial customers. Another member responded that for their company there wasn’t any negative feedback or issues. However, they had heard from the farm side of their company, when there’s a late irrigation event, they still need to check pumps to ensure they come back on. That does cause overtime for the labor, so some fields have been opted out of participating in the program. 1:38 PM-DR Potential Study & EE Potential Study – AEG – Quentin Nesbitt Quentin presented the potential study results for both DR and Energy Efficiency (EE). He discussed how the company utilizes the studies in its IRP. Quentin introduced AEG, hired to complete the studies, and said Eli Morris and Maggie Buffum from AEG were available to answer detailed questions on the studies. Discussion & Questions: One member asked about the assumptions and costs used to model the pricing-based DR programs. Quentin answered that this includes the fixed and variable costs, software, admin, and incentives. We look at the differential of the rate as being an incentive and include that in the costs. Another member asked if the study accounts for the overlap in A/C switches and a Bring Your Own Thermostat (BYOT) program. Quentin answered that AEG did account for this, and in their study gave priority to the switches but recognized that there are customers that would not participate in A/C but would participate in BYOT. The member then asked if the BYOT overlapped other EE opportunities or measures. Eli answered that they did model the assumption that smart thermostats would grow over time, but they did not model the cost coincidence between EE/DR. The member asked if the $92 for the BYOT program is a fixed cost. Quentin said it is an all-inclusive cost and includes software, incentives, and the cost that Idaho Power would have to incur to go through a third-party vendor to get access to the thermostats. All costs are gathered up and the $92 is levelized over the life of the program. Eli added, it’s levelized over a 20-year period. One member asked if the DR program estimated costs included fixed costs underlying adoption of each program. Quentin answered that all aspects of each of the program’s costs are estimated, including startup, vendor costs, and customer incentive costs. The member then asked if sunk costs of the DR programs are already accounted for. Quentin responded that those costs are not included, only estimated costs going forward are included. Another member asked if the study looked at DR as a flexible resource. Jared said the company is modeling DR differently than in the past and asked for clarification on what aspect of flexibility is being referred to. The member said mostly due to significant ramping and the duck curve. Jared answered that the primary point of analysis surrounds the timing of the net peak. The member then asked why the grid enabled water heater is so expensive. Eli responded that this is due to the underlying assumptions and that there are high fixed costs being spread over a small number of units. A guest asked how the costs are impacted by the assumption of how many events are called per season. Quentin answered depends on the program design. Our existing programs have fixed incentives, and then a variable incentive for our C&I and irrigation program after the 4th event. The costs assume full use of the programs. The guest then asked if this includes more costs than a supply side resource shown in the IRP information. Jared said that it depends on the data in the IRP, but that capacity and operating costs are considered in the IRP. Jared also said the more cost-effective supply side resources tend to be closer to the $50 per kW range but added that it is not always a perfect comparison from the numbers alone due to inherent differences in operating characteristics and timing availability of each resource. 2:14 PM-Wrap-up/Open Discussion – All Quentin discussed future meetings. Our current plan for 2023 is one in person and three virtual meetings and stated that the plan is to have the February meeting in person, but we will continue to evaluate. He noted that we will send out a Doodle poll in December to narrow down the dates for 2023. Rosemary asked everyone if there were any comments or further questions. There we no further questions or comments. 2:16 PM-Adjourn Supplement 2: Evaluation Demand-Side Management 2022 Annual Report Page 35 NEEA MARKET EFFECTS EVALUATIONS Report Title Sector Analysis Performed By Study Manager 2018 Washington State Energy Code Energy Savings Analysis for Nonresidential Buildings Commercial NORESCO NEEA Advanced Water Heating Specification Residential NEEA NEEA Analysis of Expanded Efficiency Parameters for Very High Efficiency DOAS Commercial Red Car Analytics NEEA Building Commissioning—2021 Long Term Monitoring and Tracking Report Commercial The Cadmus Group NEEA Commercial Boilers Standard Evaluation Commercial Michaels Energy NEEA Commercial HPWH Qualified Products List Commercial NEEA NEEA CTA-2045 Water Heater Demonstration Project Residential BPA NEEA Demand Response of Residential HVAC Residential Cadeo Group NEEA Efficient Rooftop Unit Tiers Market Research Commercial D + R International NEEA Energy Savings from Efficient Rooftop Units in Heating Dominated Climates Commercial Cadeo Group and Big Ladder Software NEEA ENERGY STAR Top-Load Clothes Washer Naturally Occurring Baseline Review Residential Apex Analytics NEEA Extended Motor Products Pump and Circulator Manufacturers' Representative Pilot: Market Test Assessment Commercial Johnson Consulting Group NEEA Extended Motor Products Regional Market Share Study Commercial ADM Associates NEEA Gas-Fired Rooftop Unit Efficiency Testing Task 3 Report Commercial NRCan NEEA Green Motor Rewinds—2021 Long-Term Monitoring and Tracking Report Commercial The Cadmus Group NEEA Heat Pump and Air Conditioner Efficiency Ratings: Why Metrics Matter Residential Bruce Harley Energy Consulting NEEA Heat Pump Water Heater Benefit/Cost Model Review Residential Larson Energy Research NEEA Heat Pump Water Heaters in Small Spaces Lab Testing: “The Amazing Shrinking Room” Residential Larson Energy Research and Cascade Engineering Services NEEA High-Performance Windows Market Characterization Study Residential and Commercial Cadeo Group NEEA NEEA 2023 Operations Plan Residential and Commercial NEEA NEEA NEEA Q1 2022 Codes and Standards Newsletter Residential and Commercial NEEA NEEA NEEA Q1 2022 Market Progress Report Residential and Commercial NEEA NEEA NEEA Q1 2022 Quarterly Report Residential and Commercial NEEA NEEA NEEA Q2 2022 Codes and Standards Newsletter Residential and Commercial NEEA NEEA NEEA Q2 2022 Market Progress Report Residential and Commercial NEEA NEEA NEEA Q2 2022 Quarterly Report Residential and Commercial NEEA NEEA Supplement 2: Evaluation Page 36 Demand-Side Management 2022 Annual Report Report Title Sector Analysis Performed By Study Manager NEEA Q3 2022 Codes Standards and New Construction Newsletter Residential and Commercial NEEA NEEA NEEA Q3 2022 Market Progress Report Residential and Commercial NEEA NEEA NEEA Q3 2022 Quarterly Report Residential and Commercial NEEA NEEA NEEA Q4 2021 Codes and Standards Newsletter Residential and Commercial NEEA NEEA NEEA Q4 2021 Quarterly Report Residential and Commercial NEEA NEEA NEEA Washington Energy Code Study—Frequently Asked Questions Residential and Commercial TRC NEEA Northwest Heat Pump Water Heater Market Progress Evaluation Report #6 Residential NMR Group NEEA Perfect Pairings? Testing the Energy Efficiency of Matched Washer-Dryer Sets Residential Kannah Consulting NEEA Plug-In Heat Pump Water Heaters: An Early Look to 120-Volt Products Residential Larson Energy Research and Cascade Engineering Services NEEA Power Drive System Retrofit Opportunities in the Northwest Commercial Cadeo Group NEEA Pricing Research for Efficient Water Heaters Residential Lieberman Research Group and ILLUME Advising NEEA Pump Energy Rating Label Awareness and Use Study Commercial Johnson Consulting Group NEEA Q1 2022 Emerging Technology Newsletter Residential and Commercial NEEA NEEA Q1 2022 Market Research and Evaluation Newsletter Residential and Commercial NEEA NEEA Q2 2022 Emerging Technology Newsletter Residential and Commercial NEEA NEEA Q2 2022 Market Research and Evaluations Newsletter Residential and Commercial NEEA NEEA Q3 2022 Emerging Technology Newsletter Residential and Commercial NEEA NEEA Q3 2022 Market Research and Evaluation Newsletter Residential and Commercial NEEA NEEA Q4 2021 Emerging Technology Newsletter Residential and Commercial NEEA NEEA Q4 2022 Market Research and Evaluation Newsletter Residential and Commercial NEEA NEEA RBSA 2022 Webinar #4 Slides Residential Evergreen Economics NEEA RBSA 2022 Webinar #5 Slides Residential NEEA NEEA RBSA 2022 Webinar #6 Slides Residential Evergreen Economics NEEA Refrigerator and Freezer Influence Assessment and Baseline Review Residential Apex Analytics NEEA Residential Heat Pump Water Heater Qualified Products List Residential NEEA NEEA Residential HVAC Contractor Market Research Residential Lieberman Research NEEA Supplement 2: Evaluation Demand-Side Management 2022 Annual Report Page 37 Report Title Sector Analysis Performed By Study Manager Review of Market Share Forecast and Key Assumptions for Efficient Rooftop Units Commercial Cadeo Group NEEA Review of Market Share Forecast and Key Assumptions for VHE DOAS Commercial The Cadmus Group NEEA Room Air Conditioners: ENERGY STAR Most Efficient Influence Evaluation and Baseline Assumptions Review Residential TRC Engineers NEEA Study of Influences on Northwest Variable Speed Heat Pump Adoption Residential and Commercial Lieberman Research Group NEEA Summary of Field Evaluation of Non-Glass Interior Secondary Window Attachments Commercial Pacific Northwest National Laboratory NEEA Televisions: ENERGY STAR Version 9 Specification Influence Assessment and Baseline Assumptions Review Residential TRC Engineers NEEA Uninterruptible Power Supplies Standard Evaluation Commercial Michaels Energy NEEA Variable Speed Heat Pump Product Assessment and Analysis Residential Center for Energy and Environment NEEA Variable Speed Heat Pumps – Technical Best Practices Gap Analysis Residential TRC Engineers NEEA VHE DOAS Commercial Building Decision Makers Market Research Commercial Hayden + Tanner NEEA Washington 2015 Commercial Construction Code Evaluation Study Commercial Cadmus NEEA Washington Residential Post-Code Market Research Report Residential TRC Engineers NEEA Titles appearing in blue are links to the online versions of the reports. A PDF of this supplement can be found at idahopower.com/ways-to-save/energy-efficiency-program-reports/. Supplement 2: Evaluation Page 38 Demand-Side Management 2022 Annual Report Supplement 2: Evaluation Demand-Side Management 2022 Annual Report Page 39 INTEGRATED DESIGN LAB Report Title Sector Analysis Performed By Study Manager Study/Evaluation Type 2022 Task 1: Foundational Services— Summary of Projects Commercial IDL Idaho Power Assistance and Education 2022 Task 2: Lunch and Learn—Summary of Effort and Outcomes Commercial IDL Idaho Power Training and Education 2022 Task 3: BSUG—Summary of Effort and Outcomes Commercial IDL Idaho Power Training and Education 2022 Task 4: New Construction Verifications— Summary of Projects Commercial IDL Idaho Power Verifications 2022 Task 5: Energy Resource Library— Summary of Effort and Outcomes Commercial IDL Idaho Power Assistance and Education 2022 Task 6: Power over Ethernet— Demonstration Project Commercial IDL Idaho Power Research 2022 Task 7: LLLC Workshop—Summary of Effort and Outcomes Commercial IDL Idaho Power Assistance and Education 2022 Task 8: Digital Design Tools—Summary of Effort and Outcomes Commercial IDL Idaho Power Assistance and Education Supplement 2: Evaluation Page 40 Demand-Side Management 2022 Annual Report Report Number: 2022_001-01 2022 TASK 1: FOUNDATIONAL SERVICES SUMMARY OF PROJECTS IDAHO POWER COMPANY EXTERNAL YEAR-END REPORT December 31, 2022 Prepared for: Idaho Power Company Author: Damon Woods ii This page left intentionally blank. iii Prepared by: University of Idaho Integrated Design Lab | Boise 322 E. Front St., Suite 360, Boise, ID 83702 USA www.uidaho.edu/idl IDL Director: Damon Woods Author: Damon Woods Prepared for: Idaho Power Company Contract Number: IPC KIT # 8112 Please cite this report as follows: Woods, D. (2022). 2022 TASK 1: Foundational Services – Summary of Projects (2022_001-01). University of Idaho Integrated Design Lab, Boise, ID. iv DISCLAIMER While the recommendations in this report have been reviewed for technical accuracy and are believed to be reasonably accurate, the findings are estimates and actual results may vary. All energy savings and cost estimates included in the report are for informational purposes only and are not to be construed as design documents or as guarantees of energy or cost savings. The user of this report, or any information contained in this report, should independently evaluate any information, advice, or direction provided in this report. THE UNIVERSITY OF IDAHO MAKES NO REPRESENTATIONS, EXTENDS NO WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO WARRANTIES OF MERCHANTABILITY, AND FITNESS FOR A PARTICULAR PURPOSE WITH RESPECT TO THE INFORMATION, INCLUDING BUT NOT LIMITED TO ANY RECOMMENDATIONS OR FINDINGS, CONTAINED IN THIS REPORT. THE UNIVERSITY ADDITIONALLY DISCLAIMS ALL OBLIGATIONS AND LIABILITIES ON THE PART OF UNIVERSITY FOR DAMAGES, INCLUDING, BUT NOT LIMITED TO, DIRECT, INDIRECT, SPECIAL AND CONSEQUENTIAL DAMAGES, ATTORNEYS’ AND EXPERTS’ FEES AND COURT COSTS (EVEN IF THE UNIVERSITY HAS BEEN ADVISED OF THE POSSIBLITIY OF SUCH DAMAGES, FEES OR COSTS), ARISING OUT OF OR IN CONNECTION WITH THE MANUFACTURE, USE OR SALE OF THE INFORMATION, RESULT(S), PRODUCT(S), SERVICE(S) AND PROCESSES PROVIDED BY THE UNIVERSITY. THE USER ASSUMES ALL RESPONSIBILITY AND LIABILITY FOR LOSS OR DAMAGE CAUSED BY THE USE, SALE, OR OTHER DISPOSITION BY THE USER OF PRODUCT(S), SERVICE(S), OR (PROCESSES) INCORPORATING OR MADE BY USE OF THIS REPORT, INCLUDING BUT NOT LIMITED TO DAMAGES OF ANY KIND IN CONNECTION WITH THIS REPORT OR THE INSTALLATION OF RECOMMENDED MEASURES CONTAINED HEREIN. v This page left intentionally blank. vi TABLE OF CONTENTS 1. Introduction ............................................................................................................................... 1 2. Project Summary ..................................................................................................................... 2 3. Appendix – Project Reports .................................................... Error! Bookmark not defined. ACRONYMS AND ABBREVIATIONS AIA American Institute of Architects ASHRAE American Society of Heating, Refrigeration, and Air-conditioning Engineers DOAS Dedicated Outdoor Air System EMS Energy Management System EUI Energy Use Intensity [kBtu/ft2/yr] HVAC Heating Ventilation and Air Conditioning IDL Integrated Design Lab IPC Idaho Power Company IR Infrared LED Light Emitting Diode LEED Leadership in Energy and Environmental Design NEEA Northwest Energy Efficiency Alliance RTU Rooftop Unit UI University of Idaho UVGI Ultraviolet Germicidal Irradiation VAV Variable Air Volume VRF Variable Refrigerant Flow Integrated Design Lab | Boise 1 2022 Task 1: Foundational Services- Idaho Power Company External Year-End Report (Report #2022_001-01) 1. INTRODUCTION The University of Idaho Integrated Design Lab (UI-IDL) provided technical design assistance in 2022 for energy efficiency building projects through the Foundational Services task. This program, supported by Idaho Power (IPC), offered three phases of assistance from which customers could choose. A marketing flyer shown in Figure 1 outlines the three phases. Phase I includes projects with budgets less than $2,000, Phase II is limited to projects from $2,000 to $4,000, and Phase III is any project with a budget greater than $4,000. Figure 1: Foundational Services Flyer Outlining Phases Information on the Foundational Services program was provided at each Lunch and Learn and BSUG presentation. Advertising for the program was also offered over the course of the year to local government officials, developers, and the architects and engineers who interacted with IDL. Integrated Design Lab | Boise 2 2022 Task 1: Foundational Services- Idaho Power Company External Year-End Report (Report #2022_001-01) 2. PROJECT SUMMARY The IDL worked on over 16 Foundational Service projects in 2022. Projects ranged from commercial to municipal and the IDL worked with both architecture and engineering firms within Idaho Power Service territory. Most project intake came through a phone call or email to the IDL. A tab is also available on the IDL website for people to submit requests for technical support through the foundational services program. Projects consisted of email responses, personal trainings, technical reports, and memos. In total, there were twelve Phase I projects, three Phase II projects, and one Phase III project. The full list of projects is shown in Table 1 below. Integrated Design Lab | Boise 3 2022 Task 1: Foundational Services- Idaho Power Company External Year-End Report (Report #2022_001-01) Table 1: Summary of 2022 Foundational Services Projects Project Type Phase Notes Retro/New Ft2 Location Warehouse 1 Design charette for VRF retrofit Retro 21,000 Ada County Industrial 2 Daylighting analysis training New 40,000 Ada County Office 2 Energy modeling tool analysis New 3,500 Ada County Municipal 1 Load diversification New 32,000 Ada County Software 1 Code compliance New ??Canyon County Military 3 Training on energy audits and strategic energy management Retro 30,000 Ada County Grocery 1 Modeling assistance for baseline New NA Ada County Recreation 2 Insulation and pump vfd option research New 30,000 Ada County Data Center 1 Natural ventilation method exploration New 500 Ada County Software 1 Assistance on energy modeling workflow NA Ada County Charity 1 Envelope and operational savings investigation forfacility Retro 3000 Gem County Warehouse 1 Skylight spacing strategies for particular products New NA Ada County Small Business 1 Incentive option review for SMB (small to mid-size businesses)New NA Ada County Charity 1 Analysis of cooling bills and IAQ Retro 70,000 Ada County Mixed Use 1 Researching insulation performance in cold climates New NA Blaine County Rooftop HVAC 1 Review of IAQ savings calculation method Retro NA Blaine County Report Number: 2022_002-01 2022 TASK 2: LUNCH AND LEARN SUMMARY OF EFFORT AND OUTCOMES IDAHO POWER COMPANY EXTERNAL YEAR-END REPORT December 31, 2022 Idaho Power Company Dylan Agnes ii This page left intentionally blank. iii University of Idaho Integrated Design Lab | Boise 322 E Front Street, Suite #360 Boise, ID 83702 USA www.uidaho.edu/idl Damon Woods Dylan Agnes Idaho Power Company IPC KIT #8112 Agnes, D.,(2022). 2022 TASK 2: Lunch and Learn – Summary of Effort and Outcomes (2022_002-01). University of Idaho Integrated Design Lab, Boise, ID. iv While the recommendations in this report have been reviewed for technical accuracy and are believed to be reasonably accurate, the findings are estimates and actual results may vary. All energy savings and cost estimates included in the report are for informational purposes only and are not to be construed as design documents or as guarantees of energy or cost savings. The user of this report, or any information contained in this report, should independently evaluate any information, advice, or direction provided in this report. THE UNIVERSITY OF IDAHO MAKES NO REPRESENTATIONS, EXTENDS NO WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO WARRANTIES OF MERCHANTABILITY, AND FITNESS FOR A PARTICULAR PURPOSE WITH RESPECT TO THE INFORMATION, INCLUDING BUT NOT LIMITED TO ANY RECOMMEDATIONS OR FINDINGS, CONTAINED IN THIS REPORT. THE UNIVERSITY ADDITIONALLY DISCLAIMS ALL OBLIGATIONS AND LIABILITIES ON THE PART OF UNIVERSITY FOR DAMAGES, INCLUDING, BUT NOT LIMITED TO, DIRECT, INDIRECT, SPECIAL AND CONSEQUENTIAL DAMAGES, ATTORNEYS’ AND EXPERTS’ FEES AND COURT COSTS (EVEN IF THE UNIVERSITY HAS BEEN ADVISED OF THE POSSIBLITIY OF SUCH DAMAGES, FEES OR COSTS), ARISING OUT OF OR IN CONNECTION WITH THE MANUFACTURE, USE OR SALE OF THE INFORMATION, RESULT(S), PRODUCT(S), SERVICE(S) AND PROCESSES PROVIDED BY THE UNIVERSITY. THE USER ASSUMES ALL RESPONSIBILITY AND LIABILITY FOR LOSS OR DAMAGE CAUSED BY THE USE, SALE, OR OTHER DISPOSITION BY THE USER OF PRODUCT(S), SERVICE(S), OR (PROCESSES) INCORPORATING OR MADE BY USE OF THIS REPORT, INCLUDING BUT NOT LIMITED TO DAMAGES OF ANY KIND IN CONNECTION WITH THIS REPORT OR THE INSTALLATION OF RECOMMENDED MEASURES CONTAINED HEREIN. v This page left intentionally blank. vi TABLE OF CONTENTS 1. 2022 Summary and Cumulative Analysis ................................................................................ 9 2. Session Summaries ................................................................................................................. 14 2.1 Session 1: LEED V4.1 Daylighting Credits (08/31/2022) .............................................. 14 2.2 Session 2: The Future of Lighting Controls (09/14/2022) ............................................ 14 2.3 Session 3: High Performance Classrooms (09/15/2022) ............................................. 15 2.4 Session 4: Dedicated Outdoor Air Systems (DOAS) Integration (09/20/2022) ........... 16 2.5 Session 5: The Future of Lighting Controls (09/28/2022) ............................................ 16 2.6 Session 6: Daylighting Multipliers (09/29/2022)........................................................... 17 2.7 Session 7: LLLC Training Trial Run (09/30/2022) ......................................................... 17 2.8 Session 8: LLLC Training (10/05/2022) ......................................................................... 18 2.9 Session 9: The Future of Lighting Controls (10/06/2022) ............................................ 18 2.10 Session 10: ASHRAE 36 High Performance Sequences of Operation for HVAC Systems (10/18/2022) ........................................................................................................... 19 2.11 Session 11: LED Technology Impact on Savings and Efficiency (10/21/2022) ........ 20 2.12 Session 12: Ultraviolet Germicidal Irradiation (10/28/2022) ..................................... 20 2.13 Session 13: Luminaire Level Lighting Controls (11/10/2022) ................................... 21 2.14 Session 14: Thermal Energy Storage Systems (11/17/2022) .................................... 22 3. Future Work.............................................................................................................................. 23 4. Appendices ............................................................................................................................... 23 4.1.1 Session 1: LEED V4.1 Daylighting Credits (08/31/2022) ....................................... 23 4.1.2 Session 2: The Future of Lighting Controls (09/14/2022) .................................... 24 4.1.3 Session 3: High Performance Classrooms (09/15/2022) ...................................... 26 4.1.4 Session 4: Dedicated Outdoor Air Systems (DOAS) Integration (09/20/2022) .... 27 4.1.5 Session 5: The Future of Lighting Controls (09/28/2022) ..................................... 28 4.1.6 Session 6: Daylighting Multipliers (09/29/2022).................................................... 29 4.1.7 Session 7: LLLC Training Trial Run (09/30/2022) .................................................. 30 4.1.8 Session 8: LLLC Training (10/05/2022) .................................................................. 31 4.1.9 Session 9: The Future of Lighting Controls (10/06/2022) .................................... 32 4.1.10 Session 10: ASHRAE 36 High Performance Sequences of Operation for HVAC Systems (10/18/2022) ....................................................................................................... 34 vii 4.1.11 Session 11:LED Technology Impact on Savnigs and Efficiency (10/21/2022) .. 35 4.1.12 Session 12: Ultraviolet Germicidal Irradiation (10/28/2022) .............................. 36 4.1.13 Session 13: Luminaire Level Lighting Controls (11/10/2022) ............................ 37 4.1.14 Session 14: Thermal Energy Storage Systems (11/17/2022) ............................ 38 viii ACRONYMS AND ABBREVIATIONS AIA American Institute of Architects Arch Architect(ure) ASHRAE American Society of Heating, Refrigeration, and Air-Conditioning Engineers BCGCC Boise Green Building Code BESF Building Energy Simulation Forum (Energy Trust of Oregon) Bldg. Building BOMA Building Owners and Managers Association CSI Construction Specifications Institute Cx Customer Experience DOE Department of Energy Elec. Electrical EUI Energy Use Intensity GSHP Ground Source Heat Pump HVAC Heating, Ventilation, and Air Conditioning IBOA Intermountain Building Operators Association IBPSA International Building Performance Simulation Association IDL Integrated Design Lab IECC International Energy Conservation Code IES Illuminating Engineering Society IPC Idaho Power Company LEED Leadership in Energy & Environmental Design LED Light Emitting Diode M&V Measurement and Verification Mech. Mechanical Mgmt. Management NCARB National Council of Architectural Registration Boards PoE Power over Ethernet TBD To Be Determined UI University of Idaho USGBC U.S. Green Building Council 9 1. 2022 SUMMARY AND CUMULATIVE ANALYSIS Table 1: 2022 Lunch and Learn Summary Date Title Presenter Group / Location Attendees 1 08/31 LEED V4.1 Daylighting Credits – In Person Dylan Agnes A1 7 2 09/14 The Future of Lighting Controls – In Person Dylan Agnes A1 7 3 09/15 High Performance Classrooms – In Person Damon Woods A2 7 4 09/20 Dedicated Outdoor Air Systems (DOAS) Integration – In Person Damon Woods E1 5 5 09/28 The Future of Lighting Controls – In Person Dylan Agnes E2 10 6 09/29 Daylighting Multipliers – In Person Dylan Agnes A3 9 7 09/30 LLLC Training Trial Run – In Person Dylan Agnes OL 4 8 10/05 LLLC Training – In Person Dylan Agnes OL 10 9 10/06 The Future of Lighting Controls – In Person Dylan Agnes A2 7 10 10/18 ASHRAE 36 High Performance Sequences of Operation for HVAC Systems Damon Woods E1 6 10 Table 1 on the previous page summarizes all Lunch and Learn presentations given in 2022. The statistics in this section are cumulative for the 14 presentations. At each presentation participants were asked to sign in and fill out an evaluation form. Presentations were judged on a scale of 1 to 5, (see table 2). All lunch and learn presentations given in 2022 were in-person presentations and scheduling for lectures did not begin until mid-August. Please rate the following parts of the presentation: Organization, Clarity, Opportunity for Questions, Instructor’s Knowledge Needs Improvement Good Excellent 11 Profession of Attendee Breakdown 12 7 7 7 5 9 4 6 7 8 7 6 10 10 7 0 5 10 15 20 25 30 LEED V4.1 Daylighting Credits The Future of Lighting Controls High Performance Classrooms Dedicated Outdoor Air Systems (DOAS) Integration Daylighting Multipliers LLLC Training ASHRAE 36 High Performance Sequences of Operation for HVAC Systems LED Technology Impact on Savings and Efficiency Ultraviolet Germicidal Irradiation Luminaire Level Lighting Controls Thermal Energy Storage Systems Session 1 Session 2 Session 3 13 4.52 4.55 4.51 4.65 4.88 4.61 3.53 0.00 1.00 2.00 3.00 4.00 5.00 In general, today'spresentation was:Rate organization:Rate clarity:Rate opportunity forquestions:Rate instructor'sknowledge of thesubject matter: Rate delivery ofpresentation:The content of thepresentation was: 0.00 1.00 2.00 3.00 4.00 5.00 LEED V4.1 Daylighting Credits The Future of Lighting Controls High Performance Classrooms Dedicated Outdoor Air Systems (DOAS) Integration The Future of Lighting Controls Daylighting Multipliers LLLC Training LLLC Training The Future of Lighting Controls ASHRAE 36 High Performance Sequences ofOperation for HVAC Systems LED Technology Impact on Savings and Efficiency Ultraviolet Germicidal Irradiation Luminaire Level Lighting Controls Thermal Energy Storage Systems In general, today's presentation was:Rate organization:Rate clarity:Rate opportunity for questions: Rate instructor's knowledge of the subject matter:Rate delivery of presentation:The content of the presentation was: 14 2. SESSION SUMMARIES After each lunch and learn session, an evaluation form was handed out to participants. The feedback will be used to improve future sessions. The feedback received from participants is generally constructive criticism used to keep sessions updated but also to propose future potential topics and questions to the Integrated Design Lab. 2.1 SESSION 1: LEED V4.1 DAYLIGHTING CREDITS (08/31/2022) Title: LEED V4.1 Daylighting Credits LEED Daylighting credits are one of the most difficult to achieve and requires an early investment for validation. However, investigating daylight opportunities for a project will assist in other aspects of energy efficiency, such as, estimating heating and cooling loads or integrating a building’s control systems. As such, any time spent in the early design phase investigating if a project should invest in daylighting is applicable to facets of energy efficient design that is often required for LEED projects. In this lecture we will discuss the changes from LEED V4 to V4.1 Daylighting Credits, which options work best for project types, incorporating early energy/simulation modeling into the design process, and how to run a cost-benefit analysis to determine if you should invest in daylighting. Presentation Info: Attendance: 2.2 SESSION 2: THE FUTURE OF LIGHTING CONTROLS (09/14/2022) Title: The Future of Lighting Controls Although LEDs have shown, they are a big game changer in the commercial lighting realm; lower lighting power density is not the only area of value when considering lighting. We can further increase savings from these highly efficient lighting systems by introducing control systems that collect data and user input to create an evolving feedback loop that seeks peak system operation. While LLLC’s (Luminaire Level Lighting 15 Control) use this feature, they still use the same infrastructure as the lighting and control system that have come before it, which can be a limitation for expanding the systems efficiency and integration to other building systems. We believe the internet of things (IoT) will change the lighting and controls industry, providing an excellent medium for an integrated, multi-service IoT platform. Why? Where there are people, there are lights; where there are people, there will also be the need for connectivity. New and connected lighting controls provide a means to deliver valuable IoT services and increased energy savings. Presentation Info: Attendance: 2.3 SESSION 3: HIGH PERFORMANCE CLASSROOMS (09/15/2022) Title: High Performance Classrooms : Student enrollment in Ada County is projected to grow by 1,000 students per year for the next ten years and at least six capital projects are planned in the West Ada District alone to meet this demand. This session will cover a variety of issues facing the design of an efficient, healthy, and productive classroom environment. A quick look at the state of the last 50 years of school design will give an introduction to the problems faced by designers. This session will highlight several case studies of high performance schools in the Northwest to address daylighting, natural ventilation, and integration of mechanical systems. Each passive strategy will be addressed in detail with regional examples and performance research. Presentation Info: Attendance: 16 2.4 SESSION 4: DEDICATED OUTDOOR AIR SYSTEMS (DOAS) INTEGRATION (09/20/2022) Title: Dedicated Outdoor Air Systems (DOAS) Integration In an effort to operate buildings in the most energy efficient manner, we are designing building envelopes to be as airtight as possible with as little outside air as allowable. In this presentation the following issues are addressed: significance of IAQ to human health and productivity, the link between IAQ and building energy demands, and efficient technologies for optimizing IAQ. Presentation Info: Attendance: 2.5 SESSION 5: THE FUTURE OF LIGHTING CONTROLS (09/28/2022) Title: The Future of Lighting Controls Although LEDs have shown, they are a big game changer in the commercial lighting realm; lower lighting power density is not the only area of value when considering lighting. We can further increase savings from these highly efficient lighting systems by introducing control systems that collect data and user input to create an evolving feedback loop that seeks peak system operation. While LLLC’s (Luminaire Level Lighting Control) use this feature, they still use the same infrastructure as the lighting and control system that have come before it, which can be a limitation for expanding the systems efficiency and integration to other building systems. We believe the internet of things (IoT) will change the lighting and controls industry, providing an excellent medium for an integrated, multi-service IoT platform. Why? Where there are people, there are lights; where there are people, there will also be the need for connectivity. New and connected lighting controls provide a means to deliver valuable IoT services and increased energy savings. Presentation Info: 17 Attendance: 2.6 SESSION 6: DAYLIGHTING MULTIPLIERS (09/29/2022) Title: Daylighting Multipliers This session will explore the role that daylighting multipliers are used when trying to increase the efficiency of daylighting or daylight harvesting in a building, such as, light shelves, manufactured glazing, and material specification. Furthermore, we will explore the rate of return, the ranges of efficiency, and appropriate uses between daylighting strategies and multipliers. Presentation Info: Attendance: 2.7 SESSION 7: LLLC TRAINING TRIAL RUN (09/30/2022) Title: LLLC Training Trial Run LLLCs have sensors and controls within individual fixtures that enable them to be controlled remotely or on a case-by-case basis. Remote control allows users to adjust the programming criteria or illumination levels without replacing the fixtures. In conventional lighting systems, lighting zones are defined as a collective unit and thus are centrally controlled. LLLCs however, incorporate sensors into each fixture, such as occupancy, daylight, temperature or receive/broadcast signals. Each fixture has the potential to become a semi-autonomous zone that is capable of responding to small changes in the area under each fixture. Furthermore, individual fixtures can communicate with other fixtures, using wireless or infrared signals, to share data for an even greater potential to increase energy savings and user satisfaction. Some LLLCs can be connected by gateway to transfer information collected. This data is analyzed, usually through manufacturer’s software, to provide a user interface different from a typical text editor. From there users are able to identify trends in occupancy and lighting energy consumption that can then be used to refine the building schedules for occupancy and lighting and, if applicable, for the buildings’ HVAC schedule programming. 18 Presentation Info: Attendance: 2.8 SESSION 8: LLLC TRAINING (10/05/2022) Title: LLLC Training LLLCs have sensors and controls within individual fixtures that enable them to be controlled remotely or on a case-by-case basis. Remote control allows users to adjust the programming criteria or illumination levels without replacing the fixtures. In conventional lighting systems, lighting zones are defined as a collective unit and thus are centrally controlled. LLLCs however, incorporate sensors into each fixture, such as occupancy, daylight, temperature or receive/broadcast signals. Each fixture has the potential to become a semi-autonomous zone that is capable of responding to small changes in the area under each fixture. Furthermore, individual fixtures can communicate with other fixtures, using wireless or infrared signals, to share data for an even greater potential to increase energy savings and user satisfaction. Some LLLCs can be connected by gateway to transfer information collected. This data is analyzed, usually through manufacturer’s software, to provide a user interface different from a typical text editor. From there users are able to identify trends in occupancy and lighting energy consumption that can then be used to refine the building schedules for occupancy and lighting and, if applicable, for the buildings’ HVAC schedule programming. Presentation Info: Attendance: 2.9 SESSION 9: THE FUTURE OF LIGHTING CONTROLS (10/06/2022) Title: The Future of Lighting Controls 19 Although LEDs have shown, they are a big game changer in the commercial lighting realm; lower lighting power density is not the only area of value when considering lighting. We can further increase savings from these highly efficient lighting systems by introducing control systems that collect data and user input to create an evolving feedback loop that seeks peak system operation. While LLLC’s (Luminaire Level Lighting Control) use this feature, they still use the same infrastructure as the lighting and control system that have come before it, which can be a limitation for expanding the systems efficiency and integration to other building systems. We believe the internet of things (IoT) will change the lighting and controls industry, providing an excellent medium for an integrated, multi-service IoT platform. Why? Where there are people, there are lights; where there are people, there will also be the need for connectivity. New and connected lighting controls provide a means to deliver valuable IoT services and increased energy savings. Presentation Info: Attendance: 2.10 SESSION 10: ASHRAE 36 HIGH PERFORMANCE SEQUENCES OF OPERATION FOR HVAC SYSTEMS (10/18/2022) Title: ASHRAE 36 High Performance Sequences of Operation for HVAC Systems The best equipment can still run terribly if it’s not controlled well – like a sports car in the hands of a clueless driver. Don’t let that happen to your design. Get the latest guidelines on sequences of operation for common HVAC sequences. Take advantage of Idaho Power’s incentives on HVAC energy management controls. Get a refresher proper start-up and shut down sequences for air handling units including VAVs, rooftop units, and heat pumps. Ensure that controls are in compliance with indoor air quality standards for ASHRAE 62.1 compliance and COVID mitigation. Participants will learn functional tests they can perform that can confirm that proper sequences are in place. Presentation Info: Attendance: 20 2.11 SESSION 11: LED TECHNOLOGY IMPACT ON SAVINGS AND EFFICIENCY (10/21/2022) Title: LED Technology Impact on Savings and Efficiency We will examine the effect LED technology has had on energy savings, control strategies, and future implications with continued efficient lighting technology. As lighting technology becomes more efficient it will adjust codes, incentives from utilities, and energy efficiency standards. More importantly, it will change the cost benefit analysis regarding lighting, control strategies, and occupant comfort. The LED revolution for lighting is not done and, in this lecture, we will discuss the current state of LEDs as well as the direction we are going and what we might find when we arrive. Presentation Info: Attendance: 2.12 SESSION 12: ULTRAVIOLET GERMICIDAL IRRADIATION (10/28/2022) Title: Ultraviolet Germicidal Irradiation With the arrival of COVID, there has been a surge of interest in Ultra Violet Germicidal Irradiation. During our research, the IDL found that UV systems can actually save on operational costs by reducing fan energy. Attendees will learn about the different UV technologies available, the strength needed to kill pathogens in air streams, and how to minimize the energy used to run these systems. This lecture will draw from leading researchers such as William Bahnfleth, who chaired ASHRAE’s Epidemic Task Force. By installing UVGI systems in front of cooling coils, these can help prevent microbial growth and ensure better airflow throughout the building. With building occupants increasingly mindful of airborne contaminates, it’s important for architects and engineers to be aware of these systems and how they can be integrated into a building. 21 Presentation Info: Attendance: 2.13 SESSION 13: LUMINAIRE LEVEL LIGHTING CONTROLS (11/10/2022) Title: Luminaire Level Lighting Controls LLLCs have sensors and controls within individual fixtures that enable them to be controlled remotely or on a case-by-case basis. Remote control allows users to adjust the programming criteria or illumination levels without replacing the fixtures. In conventional lighting systems, lighting zones are defined as a collective unit and thus are centrally controlled. LLLCs however, incorporate sensors into each fixture, such as occupancy, daylight, temperature or receive/broadcast signals. Each fixture has the potential to become a semi-autonomous zone that is capable of responding to small changes in the area under each fixture. Furthermore, individual fixtures can communicate with other fixtures, using wireless or infrared signals, to share data for an even greater potential to increase energy savings and user satisfaction. Some LLLCs can be connected by gateway to transfer information collected. This data is analyzed, usually through manufacturer’s software, to provide a user interface different from a typical text editor. From there users are able to identify trends in occupancy and lighting energy consumption that can then be used to refine the building schedules for occupancy and lighting and, if applicable, for the buildings’ HVAC schedule programming. Presentation Info: Attendance: 22 2.14 SESSION 14: THERMAL ENERGY STORAGE SYSTEMS (11/17/2022) Title: Thermal Energy Storage Systems Thermal Energy Storage Systems (TES) are gaining popularity as a way to mitigate peak energy use. This lecture will explore the use of things like ice-storage and ponds to minimize chiller and boiler use. This technology can be paired with ground-source heat pumps, radiant systems, and natural ventilation. Idaho typically has large temperature swings between the high and low temperatures (sometimes up to 30 F), which makes our state especially suited to shifting when heating and cooling equipment should operate. By understanding more about TES, engineers and architects alike can design unique configurations that can increase efficiency and enhance resiliency in their buildings. Presentation Info: Attendance: 23 3. FUTURE WORK Feedback was gathered from the 76 Lunch and Learn evaluations received throughout 2022. The comments from these were valuable in defining possible future Lunch and Learn topics. 4. APPENDICES APPENDIX A: SESSION SUMMARIES At the conclusion of each lunch and learn session, an evaluation form was requested from each participant. The feedback will be used to improve future sessions. Below are summaries of session information, attendance counts, and the feedback received from the evaluation forms. It should be noted that comments recorded from evaluations have not been edited in most cases, many appear exactly how the participant entered them online or how they were interpreted for translation from hand-written forms. 4.1.1 SESSION 1: LEED V4.1 DAYLIGHTING CREDITS (08/31/2022) Title: LEED V4.1 Daylighting Credits LEED Daylighting credits are one of the most difficult to achieve and requires an early investment for validation. However, investigating daylight opportunities for a project will assist in other aspects of energy efficiency, such as, estimating heating and cooling loads or integrating a building’s control systems. As such, any time spent in the early design phase investigating if a project should invest in daylighting is applicable to facets of energy efficient design that is often required for LEED projects. In this lecture we will discuss the changes from LEED V4 to V4.1 Daylighting Credits, which options work best for project types, incorporating early energy/simulation modeling into the design process, and how to run a cost-benefit analysis to determine if you should invest in daylighting. Presentation Info: 24 Attendance: Scale In general, today's presentation was: 4.8 1 Not Useful - 5 Very Useful Rate organization: 4.2 1 Needs Improvement - 5 Excellent 4.0 1 Needs Improvement - 5 Excellent Rate opportunity for questions: 4.4 1 Needs Improvement - 5 Excellent Rate instructor's knowledge of the subject matter: 4.6 1 Needs Improvement - 5 Excellent Rate delivery of presentation: 4.2 1 Needs Improvement - 5 Excellent The content of the presentation was: 3.0 1 Too Basic - 3 Just Right - 5 Too Advanced • More visuals • • Case study (x3) at the end helped wrap together the presentation as a whole. • Explanation of the new LEED V4.1 vs v4 updates • • • Walkthrough for benchmarking buildings models. Work flows for integrating energy analysis into projects. • 4.1.2 SESSION 2: THE FUTURE OF LIGHTING CONTROLS (09/14/2022) Title: The Future of Lighting Controls Although LEDs have shown, they are a big game changer in the commercial lighting realm; lower lighting power density is not the only area of value when considering lighting. We can further increase savings from these highly efficient lighting systems by introducing control systems that collect data and user input to create an evolving feedback loop that seeks peak system operation. While LLLC’s (Luminaire Level Lighting Control) use this feature, they still use the same infrastructure as the lighting and control system that have come before it, which can be a limitation for expanding the systems efficiency and integration to other building systems. We believe the internet of things (IoT) will change the lighting and controls industry, providing an 25 excellent medium for an integrated, multi-service IoT platform. Why? Where there are people, there are lights; where there are people, there will also be the need for connectivity. New and connected lighting controls provide a means to deliver valuable IoT services and increased energy savings. Date: 09/14/22 Location: A1 – Boise, ID Presenter: Dylan Agnes Architect: 3 Electrician: Engineer: Contractor: Mech. Engineer: Other*: 4 Elec. Engineer: None Specified: Total (In-Person): 7 Evaluations: No evaluations were collected due to technical difficulties Scale In general, today's presentation was: 4.9 1 Not Useful - 5 Very Useful 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent The content of the presentation was: 1 Too Basic - 3 Just Right - 5 Too • None, great job! • Great job! • Case study • • Extensive knowledge well explained • Integration and information for new technology • Examples of real life situations • The flexibility of lighting and power • Learning about systems • • 26 • 4.1.3 SESSION 3: HIGH PERFORMANCE CLASSROOMS (09/15/2022) Title: High Performance Classrooms : Student enrollment in Ada County is projected to grow by 1,000 students per year for the next ten years and at least six capital projects are planned in the West Ada District alone to meet this demand. This session will cover a variety of issues facing the design of an efficient, healthy, and productive classroom environment. A quick look at the state of the last 50 years of school design will give an introduction to the problems faced by designers. This session will highlight several case studies of high performance schools in the Northwest to address daylighting, natural ventilation, and integration of mechanical systems. Each passive strategy will be addressed in detail with regional examples and performance research. Presentation Info: Attendance: Evaluations: No evaluations were collected for this webinar. Scale In general, today's presentation was: 4.7 1 Not Useful - 5 Very Useful Rate organization: 4.6 1 Needs Improvement - 5 Excellent Rate clarity: 4.7 1 Needs Improvement - 5 Excellent Rate opportunity for questions: 4.9 1 Needs Improvement - 5 Excellent Rate instructor's knowledge of the subject matter: 4.9 1 Needs Improvement - 5 Excellent Rate delivery of presentation: 4.7 1 Needs Improvement - 5 Excellent The content of the presentation was: 3.7 1 Too Basic - 3 Just Right - 5 Too Advanced • Great job! • 27 • All of it, well done – thank you • Outside air issues • CO2 information and combined effect of systems • Good presentation overall • • • UVGI • HVAC • 4.1.4 SESSION 4: DEDICATED OUTDOOR AIR SYSTEMS (DOAS) INTEGRATION (09/20/2022) Title: Dedicated Outdoor Air Systems (DOAS) Integration In an effort to operate buildings in the most energy efficient manner, we are designing building envelopes to be as airtight as possible with as little outside air as allowable. In this presentation the following issues are addressed: significance of IAQ to human health and productivity, the link between IAQ and building energy demands, and efficient technologies for optimizing IAQ. Presentation Info: Attendance: Evaluations: Scale 1 Not Useful - 5 Very Useful 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Too Basic - 3 Just Right - 5 Too Advanced 28 • • Independent opinions – not a manufacturer Rep. • Information on DOAS was good • • • 4.1.5 SESSION 5: THE FUTURE OF LIGHTING CONTROLS (09/28/2022) Title: The Future of Lighting Controls Although LEDs have shown, they are a big game changer in the commercial lighting realm; lower lighting power density is not the only area of value when considering lighting. We can further increase savings from these highly efficient lighting systems by introducing control systems that collect data and user input to create an evolving feedback loop that seeks peak system operation. While LLLC’s (Luminaire Level Lighting Control) use this feature, they still use the same infrastructure as the lighting and control system that have come before it, which can be a limitation for expanding the systems efficiency and integration to other building systems. We believe the internet of things (IoT) will change the lighting and controls industry, providing an excellent medium for an integrated, multi-service IoT platform. Why? Where there are people, there are lights; where there are people, there will also be the need for connectivity. New and connected lighting controls provide a means to deliver valuable IoT services and increased energy savings. Presentation Info: Attendance: Evaluations: Scale In general, today's presentation was: 3.9 1 Not Useful - 5 Very Useful 29 Rate organization: 3.9 1 Needs Improvement - 5 Excellent Rate clarity: 4.0 1 Needs Improvement - 5 Excellent Rate opportunity for questions: 4.4 1 Needs Improvement - 5 Excellent Rate instructor's knowledge of the subject matter: 4.7 1 Needs Improvement - 5 Excellent Rate delivery of presentation: 4.1 1 Needs Improvement - 5 Excellent The content of the presentation was: 3.7 1 Too Basic - 3 Just Right - 5 Too Advanced • Real world example are always great • Lots of acronyms, but he did explain them. Hadn’t heard of a lot of them. • • Future outlook • Discussion about how there are used or could be • PoE talks, power is what I do, so cool new info for me • Good information on the future product to come and capabilities of future controls • • • Incentive program updates • Lighting controls, occupancy sensors, time switches • Incentive program updates • 4.1.6 SESSION 6: DAYLIGHTING MULTIPLIERS (09/29/2022) Title: Daylighting Multipliers This session will explore the role that daylighting multipliers are used when trying to increase the efficiency of daylighting or daylight harvesting in a building, such as, light shelves, manufactured glazing, and material specification. Furthermore, we will explore the rate of return, the ranges of efficiency, and appropriate uses between daylighting strategies and multipliers. Presentation Info: Attendance: 30 Evaluations: Scale In general, today's presentation was: 4.2 1 Not Useful - 5 Very Useful Rate organization: 4.0 1 Needs Improvement - 5 Excellent Rate clarity: 4.4 1 Needs Improvement - 5 Excellent Rate opportunity for questions: 4.2 1 Needs Improvement - 5 Excellent Rate instructor's knowledge of the subject matter: 5.0 1 Needs Improvement - 5 Excellent Rate delivery of presentation: 4.0 1 Needs Improvement - 5 Excellent The content of the presentation was: 3.0 1 Too Basic - 3 Just Right - 5 Too • As a former teacher, I would suggest opportunities to check participants understanding of • • • 4.1.7 SESSION 7: LLLC TRAINING TRIAL RUN (09/30/2022) Title: LLLC Training Trial Run LLLCs have sensors and controls within individual fixtures that enable them to be controlled remotely or on a case-by-case basis. Remote control allows users to adjust the programming criteria or illumination levels without replacing the fixtures. In conventional lighting systems, lighting zones are defined as a collective unit and thus are centrally controlled. LLLCs however, incorporate sensors into each fixture, such as occupancy, daylight, temperature or receive/broadcast signals. Each fixture has the potential to become a semi-autonomous zone that is capable of responding to small changes in the area under each fixture. Furthermore, individual fixtures can communicate with other fixtures, using wireless or infrared signals, to share data for an even greater potential to increase energy savings and user satisfaction. Some LLLCs can be connected by gateway to transfer information collected. This data is analyzed, usually through manufacturer’s software, to provide a user interface different from a typical text editor. From there users are able to identify trends in occupancy and lighting energy consumption that can then be used to refine the building schedules for occupancy and lighting and, if applicable, for the buildings’ HVAC schedule programming. Presentation Info: 31 Attendance: Evaluations: Scale 1 Not Useful - 5 Very Useful 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Too Basic - 3 Just Right - 5 Too Advanced 4.1.8 SESSION 8: LLLC TRAINING (10/05/2022) Title: LLLC Training LLLCs have sensors and controls within individual fixtures that enable them to be controlled remotely or on a case-by-case basis. Remote control allows users to adjust the programming criteria or illumination levels without replacing the fixtures. In conventional lighting systems, lighting zones are defined as a collective unit and thus are centrally controlled. LLLCs however, incorporate sensors into each fixture, such as occupancy, daylight, temperature or receive/broadcast signals. Each fixture has the potential to become a semi-autonomous zone that is capable of responding to small changes in the area under each fixture. Furthermore, individual fixtures can communicate with other fixtures, using wireless or infrared signals, to share data for an even greater potential to increase energy savings and user satisfaction. Some LLLCs can be connected by gateway to transfer information collected. This data is analyzed, usually through manufacturer’s software, to provide a user interface different from a typical text editor. From there users are able to identify trends in occupancy and lighting energy consumption that can then be used to refine the building schedules for occupancy and lighting and, if applicable, for the buildings’ HVAC schedule programming. Presentation Info: 32 Attendance: Evaluations: Scale 1 Not Useful - 5 Very Useful 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Too Basic - 3 Just Right - 5 Too Advanced • Very good presentation • None needed • Good presentation, possibly slow down a bit • • Explanation on occupancy and vacancy settings • System capability • Opportunity for future trainings • • • 4.1.9 SESSION 9: THE FUTURE OF LIGHTING CONTROLS (10/06/2022) Title: The Future of Lighting Controls Although LEDs have shown, they are a big game changer in the commercial lighting realm; lower lighting power density is not the only area of value when considering lighting. We can further increase savings from these highly efficient lighting systems by introducing control systems that collect data and user input to create an evolving feedback loop that seeks peak system operation. While LLLC’s (Luminaire Level Lighting Control) use this feature, they still use the same infrastructure as the lighting and control system that have 33 come before it, which can be a limitation for expanding the systems efficiency and integration to other building systems. We believe the internet of things (IoT) will change the lighting and controls industry, providing an excellent medium for an integrated, multi-service IoT platform. Why? Where there are people, there are lights; where there are people, there will also be the need for connectivity. New and connected lighting controls provide a means to deliver valuable IoT services and increased energy savings. Presentation Info: Attendance: Evaluations: Scale 1 Not Useful - 5 Very Useful 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Too Basic - 3 Just Right - 5 Too Advanced • • I thought everything was super interesting especially since I have smart lights in my house • Education on what to expect in future development of lighting controls • New technologies • • • Taking this idea to the exterior/environment for safety purposes • 34 4.1.10 SESSION 10: ASHRAE 36 HIGH PERFORMANCE SEQUENCES OF OPERATION FOR HVAC SYSTEMS (10/18/2022) Title: ASHRAE 36 High Performance Sequences of Operation for HVAC Systems The best equipment can still run terribly if it’s not controlled well – like a sports car in the hands of a clueless driver. Don’t let that happen to your design. Get the latest guidelines on sequences of operation for common HVAC sequences. Take advantage of Idaho Power’s incentives on HVAC energy management controls. Get a refresher proper start-up and shut down sequences for air handling units including VAVs, rooftop units, and heat pumps. Ensure that controls are in compliance with indoor air quality standards for ASHRAE 62.1 compliance and COVID mitigation. Participants will learn functional tests they can perform that can confirm that proper sequences are in place. Presentation Info: Attendance: Evaluations: Scale 1 Not Useful - 5 Very Useful 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Too Basic - 3 Just Right - 5 Too Advanced • • Chatting about projects • • 35 • 4.1.11 SESSION 11:LED TECHNOLOGY IMPACT ON SAVNIGS AND EFFICIENCY (10/21/2022) Title: LED Technology Impact on Savings and Efficiency We will examine the effect LED technology has had on energy savings, control strategies, and future implications with continued efficient lighting technology. As lighting technology becomes more efficient it will adjust codes, incentives from utilities, and energy efficiency standards. More importantly, it will change the cost benefit analysis regarding lighting, control strategies, and occupant comfort. The LED revolution for lighting is not done and, in this lecture, we will discuss the current state of LEDs as well as the direction we are going and what we might find when we arrive. Presentation Info: Attendance: Evaluations: Scale 1 Not Useful - 5 Very Useful 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Too Basic - 3 Just Right - 5 Too Advanced • Take more time in lecture for questions • 50 mins of information that can be expanded into a day of information • It would be interesting to see the energy difference between 1 and 2 daylight sensors • Yellow is difficult to read on screen • 36 • The future of commercial application for smart lighting systems • Future of coming attractions • Comparisons between LED and Fluorescents • • • Again, too much information condensed into one presentation, break it up into more presentations • 4.1.12 SESSION 12: ULTRAVIOLET GERMICIDAL IRRADIATION (10/28/2022) Title: Ultraviolet Germicidal irradiation With the arrival of COVID, there has been a surge of interest in Ultra Violet Germicidal Irradiation. During our research, the IDL found that UV systems can actually save on operational costs by reducing fan energy. Attendees will learn about the different UV technologies available, the strength needed to kill pathogens in air streams, and how to minimize the energy used to run these systems. This lecture will draw from leading researchers such as William Bahnfleth, who chaired ASHRAE’s Epidemic Task Force. By installing UVGI systems in front of cooling coils, these can help prevent microbial growth and ensure better airflow throughout the building. With building occupants increasingly mindful of airborne contaminates, it’s important for architects and engineers to be aware of these systems and how they can be integrated into a building. Presentation Info: Attendance: 37 Evaluations: No evaluation were handed out Scale 1 Not Useful - 5 Very Useful 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Too Basic - 3 Just Right - 5 Too Advanced • • Great information on a topic I wasn’t familiar with • Topic – Timely • • • 4.1.13 SESSION 13: LUMINAIRE LEVEL LIGHTING CONTROLS (11/10/2022) Title: Luminaire Level Lighting Controls LLLCs have sensors and controls within individual fixtures that enable them to be controlled remotely or on a case-by-case basis. Remote control allows users to adjust the programming criteria or illumination levels without replacing the fixtures. In conventional lighting systems, lighting zones are defined as a collective unit and thus are centrally controlled. LLLCs however, incorporate sensors into each fixture, such as occupancy, daylight, temperature or receive/broadcast signals. Each fixture has the potential to become a semi-autonomous zone that is capable of responding to small changes in the area under each fixture. Furthermore, individual fixtures can communicate with other fixtures, using wireless or infrared signals, to share data for an even greater potential to increase energy savings and user satisfaction. Some LLLCs can be connected by gateway to transfer information collected. This data is analyzed, usually through manufacturer’s software, to provide a user interface different from a typical text editor. From there users are able to identify trends in occupancy and lighting energy consumption that can then be used to refine the building schedules for occupancy and lighting and, if applicable, for the buildings’ HVAC schedule programming. Presentation Info: 38 Attendance: Evaluations: No evaluations were handed out Scale 1 Not Useful - 5 Very Useful 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent The content of the presentation was: 1 Too Basic - 3 Just Right - 5 Too • Need learning objectives upfront. Hard to understand why jumping into NLC vs LLLC until several slides in • Give away item (Swag)/Local examples of the system being presented • • The example of lights on/off dimmed in a cubicle/open office/hallway vs daylight • Explanation of LLLCs – How to use and best use them. The breakdown using graphics that makes the info easier to absorb • • • 4.1.14 SESSION 14: THERMAL ENERGY STORAGE SYSTEMS (11/17/2022) Title: Thermal Energy Storage Systems Thermal Energy Storage Systems (TES) are gaining popularity as a way to mitigate peak energy use. This lecture will explore the use of things like ice-storage and ponds to minimize chiller and boiler use. This technology can be paired with ground-source heat pumps, radiant systems, and natural ventilation. Idaho typically has large temperature swings between the high and low temperatures (sometimes up to 30 F), which makes our state especially suited to shifting when heating and cooling equipment should operate. By understanding more about TES, engineers and architects alike can design unique configurations that can increase efficiency and enhance resiliency in their buildings. 39 Presentation Info: Attendance: Evaluations: Scale 1 Not Useful - 5 Very Useful 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Needs Improvement - 5 Excellent 1 Too Basic - 3 Just Right - 5 Too Advanced • • Thinking about different options • Opportunities for geothermal systems and combined systems • • • 40 APPENDIX B: LUNCH AND LEARN 2022 TOPICS OFFERED High Performance Classrooms (Topic 2001) Student enrollment in Ada County is projected to grow by 1,000 students per year for the next ten years and at least six capital projects are planned in the West Ada District alone to meet this demand. This session will cover a variety of issues facing the design of an efficient, healthy, and productive classroom environment. A quick look at the state over the last 50 years of school design will introduce the problems faced by designers. This session will highlight several case studies of high-performance schools in the Northwest to address daylighting, natural ventilation, and integration of mechanical systems. Each passive strategy will be addressed in detail with regional examples and performance research. In an effort to operate buildings in the most energy efficient manner, we are designing building envelopes to be as airtight as possible with as little outside air as allowable. In this presentation the following issues are addressed: significance of IAQ to human health and productivity, the link between IAQ and building energy demands, and efficient technologies for optimizing IAQ. With the arrival of COVID, there has been a surge of interest in Ultra Violet Germicidal Irradiation. During our research, the IDL found that UV systems can actually save on operational costs by reducing fan energy. Attendees will learn about the different UV technologies available, the strength needed to kill pathogens in air streams, and how to minimize the energy used to run these systems. This lecture will draw from leading researchers such as William Bahnfleth, who chaired ASHRAE’s Epidemic Task Force. By installing UVGI systems in front of cooling coils, these can help prevent microbial growth and ensure better airflow throughout the building. With building occupants increasingly mindful of airborne contaminates, it’s important for architects and engineers to be aware of these systems and how they can be integrated into a building. Thermal Energy Storage Systems (TES) are gaining popularity as a way to mitigate peak energy use. This lecture will explore the use of things like ice-storage and ponds to minimize chiller and boiler use. This technology can be paired with ground-source heat pumps, radiant systems, and natural ventilation. Idaho typically has large temperature swings between the high and low temperatures (sometimes up to 30 F), which makes our state especially suited to shifting when heating and cooling equipment should operate. By understanding more about TES, engineers and architects alike can design unique configurations that can increase efficiency and enhance resiliency in their buildings. 41 We will examine the effect LED technology has had on energy savings, control strategies, and future implications with continued efficient lighting technology. As lighting technology becomes more efficient it will adjust codes, incentives from utilities, and energy efficiency standards. More importantly, it will change the cost benefit analysis regarding lighting, control strategies, and occupant comfort. The LED revolution for lighting is not done and, in this lecture, we will discuss the current state of LEDs as well as the direction we are going and what we might find when we arrive. This session will cover the parametric analysis tool (PAT) within OpenStudio. PAT removes the need to hand edit each model to try out different architectural design, energy efficiency measures, or mechanical systems. Participants will learn the fundamental concepts of measure writing for OpenStudio, simulation parameters, running a simulation with PAT, and how firms can utilize this feature to inform early design decisions in regards to building performance. This session will cover the role that daylighting multipliers play when trying to increase the efficiency of daylight harvesting in a building through design applications, such as, light shelves, manufactured glazing, and material specification. Participants will learn about the rate of return and energy efficiency cost effectiveness for daylighting strategies, building form, location, and multipliers. The class will explain how the layers of daylighting/electric lighting strategies and control systems and how they add or subtract to the overall efficiency of the design. Although LEDs have shown, they are a big game changer in the commercial lighting realm; lower lighting power density is not the only area of value when considering lighting. We can further increase savings from these highly efficient lighting systems by introducing control systems that collect data and user input to create an evolving feedback loop that seeks peak system operation. While LLLC’s (Luminaire Level Lighting Control) use this feature, they still use the same infrastructure as the lighting and control system that have come before it, which can be a limitation for expanding the systems efficiency and integration to other building systems. We believe the internet of things (IoT) will change the lighting and controls industry, providing an excellent medium for an integrated, multi-service IoT platform. Why? Where there are people, there are lights; where there are people, there will also be the need for connectivity. New and connected lighting controls provide a means to deliver valuable IoT services and increased energy savings. 42 Most of us think of energy modeling as an engineering exercise. The truth is that more models and simulations are performed, and to better result, if the architect understands when and how to support the process and how to utilize the output. A building energy model can provide the architect an iterative process to increase the real-world effectiveness of energy systems within a building. This session will explore the value-add of energy modeling from the architect’s perspective, providing a business case for more active involvement in advocation for energy performance modeling. LLLCs have sensors and controls within individual fixtures that enable them to be controlled remotely or on a case-by-case basis. Remote control allows users to adjust the programming criteria or illumination levels without replacing the fixtures. In conventional lighting systems, lighting zones are defined as a collective unit and thus are centrally controlled. LLLCs however, incorporate sensors into each fixture, such as occupancy, daylight, temperature or receive/broadcast signals. Each fixture has the potential to become a semi-autonomous zone that is capable of responding to small changes in the area under each fixture. Furthermore, individual fixtures can communicate with other fixtures, using wireless or infrared signals, to share data for an even greater potential to increase energy savings and user satisfaction. Some LLLCs can be connected by gateway to transfer information collected. This data is analyzed, usually through manufacturer’s software, to provide a user interface different from a typical text editor. From there users are able to identify trends in occupancy and lighting energy consumption that can then be used to refine the building schedules for occupancy and lighting and, if applicable, for the buildings’ HVAC schedule programming. LEED Daylighting credits are one of the most difficult to achieve and requires an early investment for validation. However, investigating daylight opportunities for a project will assist in other aspects of energy efficiency, such as, estimating heating and cooling loads or integrating a building’s control systems. As such, any time spent in the early design phase investigating if a project should invest in daylighting is applicable to facets of energy efficient design that is often required for LEED projects. In this lecture we will discuss the changes from LEED V4 to V4.1 Daylighting Credits, which options work best for project types, incorporating early energy/simulation modeling into the design process, and how to run a cost-benefit analysis to determine if you should invest in daylighting. Learn about ASHRAE’s recommendations for energy simulation aided design. This lecture will cover methods of integrating modeling into the design process to meet aggressive energy savings targets. Learn how to implement load-reducing modeling cycles early in the design process. Quantify the energy impact of design decisions in real time. And, use post- 43 occupancy modeling to enhance building performance. Whether trying to achieve LEED, tax credits, or efficiency incentives, energy modeling can help improve the bottom line for both designers and clients. The best equipment can still run terribly if it’s not controlled well – like a sports car in the hands of a clueless driver. Don’t let that happen to your design. Get the latest guidelines on sequences of operation for common HVAC sequences. Take advantage of Idaho Power’s incentives on HVAC energy management controls. Get a refresher proper start-up and shut down sequences for air handling units including VAVs, rooftop units, and heat pumps. Ensure that controls are in compliance with indoor air quality standards for ASHRAE 62.1 compliance and COVID mitigation. Participants will learn functional tests they can perform that can confirm that proper sequences are in place. Report Number: 2022_003-01 2022 TASK 3: BSUG SUMMARY OF EFFORT AND OUTCOMES IDAHO POWER COMPANY EXTERNAL YEAR-END REPORT December 31, 2022 Prepared for: Idaho Power Company Author: Dylan Agnes This page left intentionally blank. Prepared by: University of Idaho Integrated Design Lab | Boise 322 E Front Street, Suite #360 Boise, ID 83702 USA www.uidaho.edu IDL Director: Damon Woods Author: Dylan Agnes Prepared for: Idaho Power Company Contract Number: IPC KIT #8112 Please cite this report as follows: Agnes, D. (2022). 2022 TASK 3: BSUG – Summary of Effort and Outcomes (2022_003-01). University of Idaho Integrated Design Lab, Boise, ID. DISCLAIMER While the recommendations in this report have been reviewed for technical accuracy and are believed to be reasonably accurate, the findings are estimates and actual results may vary. All energy savings and cost estimates included in the report are for informational purposes only and are not to be construed as design documents or as guarantees of energy or cost savings. The user of this report, or any information contained in this report, should independently evaluate any information, advice, or direction provided in this report. THE UNIVERSITY OF IDAHO MAKES NO REPRESENTATIONS, EXTENDS NO WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO WARRANTIES OF MERCHANTABILITY, AND FITNESS FOR A PARTICULAR PURPOSE WITH RESPECT TO THE INFORMATION, INCLUDING, BUT NOT LIMITED TO, ANY RECOMMENDATIONS OR FINDINGS, CONTAINED IN THIS REPORT. THE UNIVERSITY ADDITIONALLY DISCLAIMS ALL OBLIGATIONS AND LIABILITIES ON THE PART OF THE UNIVERSITY FOR DAMAGES, INCLUDING, BUT NOT LIMITED TO, DIRECT, INDIRECT, SPECIAL AND CONSEQUENTIAL DAMAGES, ATTORNEYS’ AND EXPERTS’ FEES AND COURT COSTS (EVEN IF THE UNIVERSITY HAS BEEN ADVISED OF THE POSSIBLITIY OF SUCH DAMAGES, FEES OR COSTS), ARISING OUT OF OR IN CONNECTION WITH THE MANUFACTURE, USE OR SALE OF THE INFORMATION, RESULT(S), PRODUCT(S), SERVICE(S) AND PROCESSES PROVIDED BY THE UNIVERSITY. THE USER ASSUMES ALL RESPONSIBILITY AND LIABILITY FOR LOSS OR DAMAGE CAUSED BY THE USE, SALE, OR OTHER DISPOSITION BY THE USER OF PRODUCT(S), SERVICE(S), OR (PROCESSES) INCORPORATING OR MADE BY USE OF THIS REPORT, INCLUDING, BUT NOT LIMITED TO, DAMAGES OF ANY KIND IN CONNECTION WITH THIS REPORT OR THE INSTALLATION OF RECOMMENDED MEASURES CONTAINED HEREIN. TABLE OF CONTENTS Table of Contents ............................................................................................................................ 1 1. Acronyms and Abbreviations ...................................................................................................... 2 2. Introduction ................................................................................................................................ 3 3. 2022 Summary and Cumulative Analysis .................................................................................... 3 2022 Attendance ......................................................................................................................... 4 2022 Evaluations ......................................................................................................................... 5 4. Session Summaries ..................................................................................................................... 6 Session 1: Indoor Air Quality Impact Modeling (3/30/22) .......................................................... 6 Session 2: Decarbonized Building and District Energy Systems (04/27/22) ............................... 6 Session 3: Embodied Carbon, Whole Building Life Cycle Assessment, and Energy Efficiency (05/25/22) ................................................................................................................................... 7 Session 4: Benchmarking Buildings, EnergyStar, and DDX (08/24/22) ....................................... 8 Session 5: Energy Codes in Idaho (09/21/22) ............................................................................. 8 Session 6: Creating an Efficient Workflow to Design a Day-lit, Glare Free, Energy Efficient Building (10/26/22) ..................................................................................................................... 9 5. Website Maintenance and Statistics ........................................................................................ 11 6. Other Activities and Suggestions for Future Improvements .................................................... 11 7. Appendices ................................................................................................................................ 13 Appendix A: BSUG 2022 Evaluations ......................................................................................... 13 Integrated Design Lab | Boise 2 1. ACRONYMS AND ABBREVIATIONS AIA American Institute of Architects App Application ARUP London based multi-discipline firm ASHRAE American Society of Heating, Refrigeration, and Air-Conditioning Engineers BCVTP Building Controls Virtual Test-Bed BEMP Building Energy Modeling Professional BESF Building Energy Simulation Forum (Energy Trust of Oregon) BIM Building Information Modeling BOMA Building Owners and Managers Association BSME Bachelor of Science in Mechanical Engineering BSUG Building Simulation Users’ Group CBECS Commercial Building Energy Consumption Survey Comm Commercial Elec. Electrical HePESC Heat Pump Energy Savings Calculator HVAC Heating, Ventilation, and Air Conditioning IBPSA International Building Performance Simulation Association IDL Integrated Design Lab IPC Idaho Power Company LBNL Lawrence Berkeley National Laboratory LEED Leadership in Energy & Environmental Design LLLC Luminaire Level Lighting Control M. Arch Masters of Architecture ME Mechanical Engineer(ing) Mech. Mechanical MEP Mechanical, Electrical, and Plumbing MS Arch Masters of Science Architecture NCARB National Council of Architectural Registration Boards RDA Revit Daylighting Analysis TMY Typical Meteorological Year UDC Urban Design Center UI University of Idaho USGBC U.S. Green Building Council Integrated Design Lab | Boise 3 2. INTRODUCTION The 2022 Idaho Power scope of work for the Building Simulation Users’ Group (BSUG) task included planning, organization and hosting of six meetings, recording attendance and evaluations, archiving video of the presentations, and maintaining the BSUG 2.0 on the IDL website which can be found here: (http://www.idlboise.com/content/bsug-20). 3. 2022 SUMMARY AND CUMULATIVE ANALYSIS In 2022, six sessions were coordinated and hosted. Sessions are summarized below with details in the following sections. Table 1: Overall Summary of Sessions Presenter Company Date Title Presenter In-person Online In-person Online 3/30 Indoor Air Quality Impact Modeling Kelsey Ramsey IDL - 22 - 22 5/25 AE - 60 - 30 10/26 Marco Aguirre Cove 11 34 8 - 23 231 92 103 254 195 Integrated Design Lab | Boise 4 2022 Attendance Figure 1: Attendee Count by Session and Type Table 2: Overall Attendance Breakdown Architect: 16 Electrician: 0 Engineer: 23 Contractor: 0 Mech. Engineer: 2 Other: 154 Elec. Engineer: 0 None Specified: 0 Total (In-Person): Total (Online): Total (Combined): 0 0 0 13 71 8 22 29 30 9 13 0 0 10 20 30 40 50 60 70 80 90 Indoor Air Quality Impact Modeling Decarbonized Building and District Energy Systems Embodied Carbon, Whole Building Life Cycle Assessment,and Energy Efficiency Benchmarking Buildings EnergyStar and DDX Energy Codes in Idaho Creating an Efficient Workflow to Design a Day-lit, Glare- free, Energy Efficient Building Number of Attendees In-Person Online Architect8% Engineer 12% Mech. Engineer 1% Other 79% Total (In- Person) 47% Total (Online)53% Integrated Design Lab | Boise 5 2022 Evaluations Figure 4: Average Evaluations by Session Figure 5: Average Evaluation Scores for All Sessions 0.0 1.0 2.0 3.0 4.0 5.0 Indoor Air Quality ImpactModeling Decarbonized Building andDistrict Energy Systems Embodied Carbon, WholeBuilding Life CycleAssessment, and EnergyEfficiency Benchmarking BuildingsEnergyStar and DDX Energy Codes in Idaho Creating an EfficientWorkflow to Design a Day-lit,Glare-free, Energy EfficientBuilding Average Evaluation Scores By Session In general, today's presentation was:Rate organization:Rate clarity: Rate opportunity for questions:Rate instructor's knowledge of the subject matter:Rate delivery of presentation: The content of the presentation was: 3.97 4.35 4.37 4.60 4.65 4.29 3.23 0.0 1.0 2.0 3.0 4.0 5.0 In general, today's presentation was: Rate organization: Rate clarity:Rate opportunity for questions: Rate instructor's knowledge of the subject matter: Rate delivery of presentation: The content of the presentation was: Integrated Design Lab | Boise 6 4. SESSION SUMMARIES Session 1: Indoor Air Quality Impact Modeling (3/30/22) Title: Indoor Air Quality Impact Modeling Date: 03/30/22 Description: COVID-19 has brought the issue of indoor air quality to the forefront of building science. Virus mitigation strategies range in effectiveness, efficiency, and costs depending on the building type, use types, and local climate. Using Open Studio and Energy+, the IDL examined the energy and cost impacts of six different mitigation strategies for commercial buildings in the Treasure Valley. Presenter: Kelsey Ramsey Attendance: Architect: 2 Electrician: Engineer: 6 Contractor: Mech. Engineer: Other*: 5 Elec. Engineer: None Specified: 9 Total (In-Person): Total (Online): *If 'Other' was noted: Principal, Building Surveyor, Project Consultant, PhD Student Session 2: Decarbonized Building and District Energy Systems (04/27/22) Title: Decarbonized Building and District Energy Systems Date: 04/27/22 Description: Due to demands caused by climate change, the energy sector is undergoing a rapid transition. Energy systems for buildings and communities need to become decarbonized, grid- responsive/efficient, resilient, and adaptive to changes in usage, technology options, and markets. This leads to increased complexity in their design and operation. Fortunately, new energy systems provide an opportunity to integrate and optimize renewables and storage across multiple prosumers and energy carriers. New system architectures and control challenges emerge, as do new requirements on design flows that can manage the increased complexity. After laying out these challenges, we will present recent progress on new generation computational tools for building and district energy and control systems. We will also present new tool chains that allow for rapid system-level prototyping, model- Integrated Design Lab | Boise 7 based design flow and digitization, ranging from design to installation and operation. We will close with a discussion about what foundation should be built to meet design and operation challenges of decarbonized energy efficient systems. Presenter: Michael Wetter Attendance: Session 3: Embodied Carbon, Whole Building Life Cycle Assessment, and Energy Efficiency (05/25/22) Title: Embodied Carbon, Whole Building Life Cycle Assessment, and Energy Efficiency Date: 05/25/22 Description: The built industry has focused its efforts on measuring and reducing operational carbon emissions, carbon emissions related to materials used in our projects is gaining relevance; measuring, understanding, and reducing these emissions should be a key addition to all design practices. This presentation will cover general embodied carbon concepts, Whole-Building Life-Cycle Assessment (WBLCA) tools to quantity embodied carbon in buildings, and tools for all disciplines to start the conversations. Presenter: Victoria Herrero-Garcia Attendance: Architect: 4 Electrician: Engineer: 5 Contractor: Mech. Engineer: 2 Other*: 4 Elec. Engineer: None Specified: 15 Total (In-Person): Total (Online): *If 'Other' was noted: Designer, Systems Analyst, PhD Student, Director of Building and Grounds Architect: 1 Contractor: Mech. Engineer: 3 Other*: 6 Elec. Engineer: None Specified: 19 Total (In-Person): Total (Online): *If 'Other' was noted: Director of Energy and Utilities, Student, Building System Analyst, Professor Emeritus Integrated Design Lab | Boise 8 Session 4: Benchmarking Buildings, EnergyStar, and DDX (08/24/22) Title: Benchmarking Buildings, EnergyStar, and DDX Date: 08/24/22 Description: Benchmarking is a method for measuring a building’s energy efficiency by comparing its energy use to other buildings with similar functions (commercial office, school, warehouse, etc…). Benchmarking allows owners to take a snapshot of how their building is performing currently in regards to energy consumption and then compare the performance to other buildings to infer if improvements can be made. In addition, software developed by the Government or organizations, AIA and AHSRAE, can be used to further evaluate a building’s performance. Software, such as, EnergyStar’s Portfolio Manager will assist with tracking a building, sharing information, performing data analysis, setting goals, and meeting those goals. Presenter: Dylan Agnes Attendance: Architect: 7 Electrician: Engineer: 5 Contractor: Mech. Engineer: 2 Other*: 1 Elec. Engineer: None Specified: 9 Total (In-Person): Total (Online): *If 'Other' was noted: Interior Design Session 5: Energy Codes in Idaho (09/21/22) Title: Energy Codes in Idaho Date: 09/21/22 Description: The energy code and its value to Idahoans is under great discussion and debate in recent months as the Idaho Division of Occupational and Professional Licenses has brought all codes under full review in response to the Governor’s Executive Order for Zero-Based Rulemaking. As rule makers engage with the public through these discussions, questions arise about what value an energy code, or specific sections therein, bring to a state like Idaho and its local communities. The discussion will be moderated by Dan Russell, PE. • Do the measures captured in the energy code actually save building owners money? • Are the measures cost-effective? Integrated Design Lab | Boise 9 • Do energy code measures offer any life safety, health or environmental quality benefits? • Are energy code measures enforceable? • Does the energy code pose an undue burden on those financing building construction? • Does the energy code benefit any stakeholders in a uniquely positive way? • How does the energy code or lack of one impact the local electric utility demand and associated payer rates? • Can the energy code be feasibly diced up into sections or individual measures such that there is a middle ground between retaining the full energy code and eliminating it all together? • If so, what specific measures are best candidates for meeting this middle ground? Many of these questions and possibly questions you have will be discussed by this industry panel. We believe this is an extremely timely topic for our Society, our Chapter and our Idaho community. Please register today to join us and we encourage you to submit 1 or 2 questions during the registration process that you would like to be considered for inclusion in the question set for the panel. Presenters: Michael Hyde, Patrick Sullivan, Mike Jones, Damon Woods, Bob Tikker Attendance: Architect: Electrician: Engineer: Contractor: Mech. Engineer: Other*: Elec. Engineer: None Specified: 84 Total (In-Person): Total (Online): *If 'Other' was noted: Session 6: Creating an Efficient Workflow to Design a Day-lit, Glare Free, Energy Efficient Building (10/26/22) Title: Creating an Efficient Workflow to Design a Day-lit, Glare Free, Energy Efficient Date: 10/26/22 Description: In this webinar, we will look at typical challenges that prevent the adoption of internal sustainability approaches as well as the business benefits of standardizing a sustainability workflow. We will learn how to use data-driven design to balance sustainability and cost and how platforms like cove.tool are integrating new technologies to help design teams win more projects and stay ahead of the conversation. By the end, attendees will have a new understanding of putting together an analysis checklist and how to reach their performance targets. Integrated Design Lab | Boise 10 Presenter: Marco Aguirre Attendance: Architect: 2 Electrician: Engineer: 4 Contractor: Mech. Engineer: Other*: 2 Elec. Engineer: None Specified: Total (In-Person): Total (Online): *If 'Other' was noted: Student Integrated Design Lab | Boise 11 5. WEBSITE MAINTENANCE AND STATISTICS The Google site “BSUG 2.0” was retired in 2020 and has been integrated into the new idlboise.com website. Each month, details about the upcoming presentations were posted to the ‘EVENTS and NEWS’ pages. These pages also included links to both webinar and in-person registration. Monthly emails linked to these pages as well as directly to the registration sites are sent out to users subscribed to our mailing list. If the monthly session included a webinar recording, the video was edited and posted to the YouTube channel with a link from the BSUG 2.0 video archive. The IDL developed a blog section within the BSUG content where we post on past topics, emerging technologies, and simulation software workflows. 6. OTHER ACTIVITIES AND SUGGESTIONS FOR FUTURE IMPROVEMENTS We saw an increase in average attendance for each session this year as well as overall attendance from 2021. While we are happy that we have increased our attendance despite the webinar format, it should be noted that attendance for the treasure valley is still down. Attendance this year was successful for the BSUG task with 6 sessions completed and 195 total attendees – 92 in-person and 103 online. Feedback was provided by attendees via the ZOOM platform by conducting polls at the end of lecture, or when the Q&A portion started. We received 64 responses with a response rate of 33% in 2022. The ZOOM platform does not allow participants to give written comments as a form of feedback for polling. Comments moving forward will be limited to in-person evaluations. A round table meeting was held on December 7th, 2022 to provide feedback on topics presented this year as well as suggestions for 2023 lecture topics. The feedback is summarized below. In addition, we have an online survey for participants who attend via webinar to also Integrated Design Lab | Boise 12 provide feedback. The results of the online survey will be presented in the 2023 kick off meeting. • Benchmarking building case studies (Warehouse, Office, School) • An emerging technology • Quality control measures/manage building upgrades • Grasshopper pollination tool • Project Stasio (data visualization) • Warehouse efficient design and practices • BetterBricks software • ASHRAE join session (standard assumption inputs) Integrated Design Lab | Boise 13 7. APPENDICES Appendix A: BSUG 2022 Evaluations Summaries of evaluations for each of the 6 sessions are recorded below. It should be noted that comments typically collected with evaluation are unavailable due to restriction from the ZOOM platform. Session 1 (03/30/22): Indoor Air Quality Impact Modeling Presentation Info: Date: 03/30/22 Location: Online Webinar Presenter: Kelsey Ramsey – IDL Attendance: Architect: 2 Electrician: Engineer: 6 Contractor: Mech. Engineer: Other*: 5 Elec. Engineer: None Specified: 9 Total (In-Person): Total (Online): 22 *If 'Other' was noted: Principal, Building Surveyor, Project Consultant, PhD Student Evaluations: Scale In general, today's presentation was: 4.1 1 Not Useful - 5 Very Useful Rate organization: 4.7 1 Needs Improvement - 5 Excellent Rate clarity: 4.5 1 Needs Improvement - 5 Excellent Rate opportunity for questions: 4.5 1 Needs Improvement - 5 Excellent Rate instructor's knowledge of the subject matter: 4.2 1 Needs Improvement - 5 Excellent Rate delivery of presentation: 4.4 1 Needs Improvement - 5 Excellent The content of the presentation was: 3.4 1 Too Basic - 3 Just Right - 5 Too Advanced Comments: No comments were made on evaluations collected. Integrated Design Lab | Boise 14 Session 2 (04/27/21): Decarbonized Building and District Energy Systems Presentation Info: Date: 04/27/2022 Location: Online Webinar Presenter: Michael Wetter – LBNL Attendance: Architect: 1 Electrician: Engineer: 3 Contractor: Mech. Engineer: Other*: 6 Elec. Engineer: None Specified: 19 Total (In-Person): Total (Online): 29 *If 'Other' was noted: Evaluations: Scale 3.7 1 Not Useful - 5 Very Useful 4.3 1 Needs Improvement - 5 Excellent 3.9 1 Needs Improvement - 5 Excellent 4.6 1 Needs Improvement - 5 Excellent 4.9 1 Needs Improvement - 5 Excellent 4.1 1 Needs Improvement - 5 Excellent 3.9 Comments: No comments were made on evaluations collected. Session 3 (05/25/22): Embodied Carbon, Whole Building Life Cycle Assessment, and Energy Efficiency Presentation Info: Date: 05/25/2022 Location: Online Webinar Presenter: Victoria Herrero-Garcia – AE Attendance: Architect: 4 Electrician: Engineer: 5 Contractor: Mech. Engineer: 2 Other*: 4 Elec. Engineer: None Specified: 15 Total (In-Person): 0 Total (Online): 30 Integrated Design Lab | Boise 15 *If 'Other' was noted: Evaluations: Scale 4.0 1 Not Useful - 5 Very Useful 4.4 1 Needs Improvement - 5 Excellent 4.5 1 Needs Improvement - 5 Excellent 4.6 1 Needs Improvement - 5 Excellent 4.6 1 Needs Improvement - 5 Excellent 4.5 1 Needs Improvement - 5 Excellent 3.3 Comments: No comments were made on evaluations collected. Session 4 (08/24/22): Benchmarking Buildings, EnergyStar, and DDX Presentation Info: Date: 08/24/2022 Location: IDL Presenter: Dylan Agnes – IDL Attendance: Architect: 7 Electrician: Engineer: 5 Contractor: Mech. Engineer: Other*: 1 Elec. Engineer: None Specified: 9 Total (In-Person): 13 Total (Online): 9 *If 'Other' was noted: Interior Design Evaluations: Scale In general, today's presentation was: 4.1 1 Not Useful - 5 Very Useful Rate organization: 3.9 1 Needs Improvement - 5 Excellent Rate clarity: 4.4 1 Needs Improvement - 5 Excellent Rate opportunity for questions: 4.9 1 Needs Improvement - 5 Excellent Rate instructor's knowledge of the subject matter: 4.7 1 Needs Improvement - 5 Excellent Rate delivery of presentation: 4.0 1 Needs Improvement - 5 Excellent The content of the presentation was: 2.7 1 Too Basic - 3 Just Right - 5 Too Advanced Comments: No comments were made on evaluations collected. Integrated Design Lab | Boise 16 Session 5 (09/21/22): Energy Codes in Idaho Session 6 (10/26/22): Creating an Efficient Workflow to Design a Day-lit, Glare-free, Energy Efficient Building Presentation Info: Date: 10/26/2022 Location: IDL Presenter: Marco Aguirre – Cove Attendance: Architect: 2 Electrician: Engineer: 4 Contractor: Mech. Engineer: Other*: 2 Elec. Engineer: None Specified: Total (In-Person): 8 Total (Online): 0 Presentation Info: Date: 09/21/2022 Location: The Creative Space Presenters: Michael Hyde, Patrick Sullivan, Mike Jones, Damon Woods, Bob Tikker – ASHRAE Panel Attendance: Architect: Electrician: Engineer: Contractor: Mech. Engineer: Other*: Elec. Engineer: None Specified: 84 Total (In-Person): 71 Total (Online): 13 *If 'Other' was noted: Evaluations: No evaluations were collected Scale In general, today's presentation was: 0.0 1 Not Useful - 5 Very Useful Rate organization: 0.0 1 Needs Improvement - 5 Excellent Rate clarity: 0.0 1 Needs Improvement - 5 Excellent Rate opportunity for questions: 0.0 1 Needs Improvement - 5 Excellent Rate instructor's knowledge of the subject matter: 0.0 1 Needs Improvement - 5 Excellent Rate delivery of presentation: 0.0 1 Needs Improvement - 5 Excellent The content of the presentation was: 0.0 1 Too Basic - 3 Just Right - 5 Too Advanced Comments: No comments were made on evaluations collected. Integrated Design Lab | Boise 17 *If 'Other' was noted: Student Evaluations: Scale In general, today's presentation was: 4.0 1 Not Useful - 5 Very Useful Rate organization: 4.6 1 Needs Improvement - 5 Excellent Rate clarity: 4.5 1 Needs Improvement - 5 Excellent Rate opportunity for questions: 4.5 1 Needs Improvement - 5 Excellent Rate instructor's knowledge of the subject matter: 4.9 1 Needs Improvement - 5 Excellent Rate delivery of presentation: 4.5 1 Needs Improvement - 5 Excellent The content of the presentation was: 2.9 1 Too Basic - 3 Just Right - 5 Too Advanced Comments: No comments were made on evaluations collected. Report Number: 2022_004-01 2022 TASK 4: NEW CONSTRUCTION VERIFICATIONS SUMMARY OF PROJECTS IDAHO POWER COMPANY EXTERNAL YEAR-END REPORT December 31, 2022 Prepared for: Idaho Power Company Author: Dylan Agnes ii This page left intentionally blank. iii Prepared by: University of Idaho Integrated Design Lab | Boise 322 E Front Street Suite #360 Boise, ID 83702 USA www.uidaho.edu/idl IDL Director: Damon Woods Authors: Dylan Agnes Prepared for: Idaho Power Company Contract Number: IPC KIT #8112 Please cite this report as follows: Agnes, D. (2022). 2022 TASK 4: New Construction Verifications – Summary of Projects (2022_004- 01). University of Idaho Integrated Design Lab, Boise, ID. iv DISCLAIMER While the recommendations in this report have been reviewed for technical accuracy and are believed to be reasonably accurate, the findings are estimates and actual results may vary. All energy savings and cost estimates included in the report are for informational purposes only and are not to be construed as design documents or as guarantees of energy or cost savings. The user of this report, or any information contained in this report, should independently evaluate any information, advice, or direction provided in this report. THE UNIVERSITY OF IDAHO MAKES NO REPRESENTATIONS, EXTENDS NO WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO WARRANTIES OF MERCHANTABILITY, AND FITNESS FOR A PARTICULAR PURPOSE WITH RESPECT TO THE INFORMATION, INCLUDING BUT NOT LIMITED TO ANY RECOMMEDATIONS OR FINDINGS, CONTAINED IN THIS REPORT. THE UNIVERSITY ADDITIONALLY DISCLAIMS ALL OBLIGATIONS AND LIABILITIES ON THE PART OF UNIVERSITY FOR DAMAGES, INCLUDING, BUT NOT LIMITED TO, DIRECT, INDIRECT, SPECIAL AND CONSEQUENTIAL DAMAGES, ATTORNEYS’ AND EXPERTS’ FEES AND COURT COSTS (EVEN IF THE UNIVERSITY HAS BEEN ADVISED OF THE POSSIBLITIY OF SUCH DAMAGES, FEES OR COSTS), ARISING OUT OF OR IN CONNECTION WITH THE MANUFACTURE, USE OR SALE OF THE INFORMATION, RESULT(S), PRODUCT(S), SERVICE(S) AND PROCESSES PROVIDED BY THE UNIVERSITY. THE USER ASSUMES ALL RESPONSIBILITY AND LIABILITY FOR LOSS OR DAMAGE CAUSED BY THE USE, SALE, OR OTHER DISPOSITION BY THE USER OF PRODUCT(S), SERVICE(S), OR (PROCESSES) INCORPORATING OR MADE BY USE OF THIS REPORT, INCLUDING BUT NOT LIMITED TO DAMAGES OF ANY KIND IN CONNECTION WITH THIS REPORT OR THE INSTALLATION OF RECOMMENDED MEASURES CONTAINED HEREIN. v This page left intentionally blank. Integrated Design Lab | Boise vi 2022 Task 4: New Construction Verifications - Idaho Power Company External Year-End Report (Report #2022_004-01) vi TABLE OF CONTENTS 1. Introduction ................................................................................................................................ 1 2. 2022 New Construction Verification Projects ............................................................................. 1 3. 2022 Photo Controls Review Projects ......................................................................................... 5 ACRONYMS AND ABBREVIATIONS AC Air Conditioning NCV New Construction Verification HVAC Heating, Ventilation, and Air Conditioning IDL Integrated Design Lab IPC Idaho Power Company UI University of Idaho VRF Variable Refrigerant Flow HP Heat Pump Integrated Design Lab | Boise 1 2022 Task 4: New Construction Verifications- Idaho Power Company External Year-End Report (Report #2022_004-01) 1 1. INTRODUCTION The University of Idaho Integrated Design Lab (UI-IDL) had two roles for the New Construction Verification (NCV) task in 2022. The primary role is to conduct on-site verification reports for approximately 10% of projects that participated in Idaho Power Company’s (IPC) New Construction Program. The verified projects were randomly selected from the projects paid in 2022, and at least four projects were required to be outside the Boise/Meridian/Eagle/Kuna area. The purpose of the project reviews and on site verifications is to assist IPC in program quality assurance. The on site verification also looks to capture any inconsistences between the final application and what was installed on site. The secondary role is to review the photo controls design and function for every project whose application included incentive L3: Daylight Photo Controls within the New Construction Program. Once each review was concluded, a letter of support for the incentive was submitted to Idaho Power. The review and letter provides IPC the information needed to pay the L3 incentive and quality of design through the inclusion of additional design and commissioning recommendations. 2. 2022 NEW CONSTRUCTION VERIFICATION PROJECTS The UI-IDL completed eight New Construction Verification projects in 2022. A detailed report for each project was submitted to IPC, including claimed and actual installation for each specific incentive the project applied for. All of the projects reviewed in 2022 were finalized and paid in 2022. One project resides under the 2016 program, three projects reside under the 2018 program format, and the rest reside under the 2021 program format. The specific incentives for this program are outlined in Tables 1, 2, and 3. Integrated Design Lab | Boise 2 2022 Task 4: New Construction Verifications- Idaho Power Company External Year-End Report (Report #2022_004-01) 2 Table 1: 2016 New Construction Program Specific Incentives Lighting L1 Interior Light Load Reduction L2 Exterior Light Load Reduction L3 Daylight Photo Controls L4 Occupancy Sensors L5 High Efficiency Exit Signs Air Conditioning A1 Efficient Air-Cooled AC & Heat Pump Units A2 Efficient VRF Units A3 Efficient Chillers A4 A5 A6 Direct Evaporative Coolers Evaporative Pre-coolers on Air-cooled C4 C5 Kitchen Hood Variable Speed Drives Onion/Potato Shed Ventilation Variable Speed Heating D1 EnergyStar Undercounter Dishwashers R2 Floating Suction Controls Integrated Design Lab | Boise 3 2022 Task 4: New Construction Verifications- Idaho Power Company External Year-End Report (Report #2022_004-01) 3 Table 2: 2018 New Construction Program Specific Incentives Lighting L1 Interior Light Load Reduction L2 Exterior Light Load Reduction L3 Daylight Photo Controls L4 Occupancy Sensors L5 High Efficiency Exit Signs Air Conditioning A1 Efficient Air-Cooled AC & Heat Pump Units A2 Efficient VRF Units A3 Efficient Chillers A4 A5 Direct Evaporative Coolers C4 C5 Kitchen Hood Variable Speed Drives Onion/Potato Shed Ventilation Variable Speed Heating D1 EnergyStar Undercounter Dishwashers R2 Floating Suction Controls Integrated Design Lab | Boise 4 2022 Task 4: New Construction Verifications- Idaho Power Company External Year-End Report (Report #2022_004-01) 4 Table 3: 2021 New Construction Program Specific Incentives Lighting L1 Interior Light Load Reduction L2 Exterior Light Load Reduction L3 Luminaire Level Lighting Controls (LLLC) L4 Occupancy Sensors L5 High Efficiency Exit Signs Air Conditioning A1 Efficient Air-Cooled AC & Heat Pump Units A2 Efficient VRF Units A3 Efficient Chillers A4 A5 A6 A7 Direct & Indirect Evaporative Coolers High-Volume Low-Speed Fan Evaporative Pre-Coolers on Air-cooled C4 C5 Kitchen Hood Variable Speed Drives Onion/Potato Shed Ventilation Variable Speed Heating I1 E1 E2 Efficient Ice Machines Circulating Generator Block Heaters High Efficiency Battery Chargers R2 R3 Automatic High-speed Doors Evaporative Pre-coolers on Air-cooled Table 4 summarizes the eight projects and respective qualified incentive measures which were verified by UI-IDL. For the projects listed, more than 50% were located outside the capital service area. Integrated Design Lab | Boise 5 2022 Task 4: New Construction Verifications- Idaho Power Company External Year-End Report (Report #2022_004-01) 5 Table 4: Project Summary IPC Project # Facility Description Location 16-347 Medical (Non-Hospital) Nampa, ID L1, L2 05/19/22 18-507 School – Elementary Nampa, ID C1 07/27/22 18-508 School – Elementary Nampa, ID C1 07/27/22 18-542 Nampa, ID 04/26/22 21-080 Garden City, ID L1, L2 21-149 Boise, ID L1 10/17/22 3. 2022 PHOTO CONTROLS REVIEW PROJECTS In 2022, the UI-IDL received zero inquiries regarding the New Construction photo controls incentive review. Report Number: 2022_005-05 2022 TASK 5: ENERGY RESOURCE LIBRARY SUMMARY OF EFFORT AND OUTCOMES IDAHO POWER COMPANY EXTERNAL YEAR-END REPORT December 31, 2022 Idaho Power Company Dylan Agnes ii This page left intentionally blank. iii University of Idaho Integrated Design Lab | Boise 322 E Front St. Suite 360 Boise, ID 83702 USA www.uidaho.edu/idl Damon Woods Dylan Agnes Idaho Power Company IPC KIT #8112 Agnes, D. (2022). 2022 TASK 5: Energy Resource Library – Summary of Effort and Outcomes (2022_005-05). University of Idaho Integrated Design Lab, Boise, ID. iv While the recommendations in this report have been reviewed for technical accuracy and are believed to be reasonably accurate, the findings are estimates and actual results may vary. All energy savings and cost estimates included in the report are for informational purposes only and are not to be construed as design documents or as guarantees of energy or cost savings. The user of this report, or any information contained in this report, should independently evaluate any information, advice, or direction provided in this report. THE UNIVERSITY OF IDAHO MAKES NO REPRESENTATIONS, EXTENDS NO WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO WARRANTIES OF MERCHANTABILITY, AND FITNESS FOR A PARTICULAR PURPOSE WITH RESPECT TO THE INFORMATION, INCLUDING BUT NOT LIMITED TO ANY RECOMMEDATIONS OR FINDINGS, CONTAINED IN THIS REPORT. THE UNIVERSITY ADDITIONALLY DISCLAIMS ALL OBLIGATIONS AND LIABILITIES ON THE PART OF UNIVERSITY FOR DAMAGES, INCLUDING, BUT NOT LIMITED TO, DIRECT, INDIRECT, SPECIAL AND CONSEQUENTIAL DAMAGES, ATTORNEYS’ AND EXPERTS’ FEES AND COURT COSTS (EVEN IF THE UNIVERSITY HAS BEEN ADVISED OF THE POSSIBLITIY OF SUCH DAMAGES, FEES OR COSTS), ARISING OUT OF OR IN CONNECTION WITH THE MANUFACTURE, USE OR SALE OF THE INFORMATION, RESULT(S), PRODUCT(S), SERVICE(S) AND PROCESSES PROVIDED BY THE UNIVERSITY. THE USER ASSUMES ALL RESPONSIBILITY AND LIABILITY FOR LOSS OR DAMAGE CAUSED BY THE USE, SALE, OR OTHER DISPOSITION BY THE USER OF PRODUCT(S), SERVICE(S), OR (PROCESSES) INCORPORATING OR MADE BY USE OF THIS REPORT, INCLUDING BUT NOT LIMITED TO DAMAGES OF ANY KIND IN CONNECTION WITH THIS REPORT OR THE INSTALLATION OF RECOMMENDED MEASURES CONTAINED HEREIN. v This page left intentionally blank. vi Table of Contents 1. Introduction ................................................................................................................................ 8 2. Marketing ................................................................................................................................... 9 3. New Tools & Tool Calibration Plan .......................................................................................... 12 4. 2022 Summary of Loans ........................................................................................................ 14 5. Appendices ............................................................................................................................... 19 vii AC Air Conditioning AIA American Institute of Architects AHU Air Handling Unit Amp Ampere ASHRAE American Society of Heating, Refrigeration, and Air-Conditioning Engineers BOMA Building Owners and Managers Association BSU Boise State University CO2 Carbon Dioxide CT Current Transducer Cx Commissioning DCV Demand Control Ventilation EE Energy Efficiency EEM(s) Energy Efficiency Measure(s) fc Foot-Candle HVAC Heating, Ventilation, and Air Conditioning IAC Industrial Assessment Center IBOA Intermountain Building Operators Association IDL Integrated Design Lab Int. International IPC Idaho Power Company kW Kilowatt kWh Kilowatt-Hour M&V Measurement and Verification OSA Outside Air PG&E Pacific Gas and Electric Company PPM Parts Per Million RPM Rotations Per Minute RTU Rooftop Unit ERL Energy Resource Library TPS Third Party Service UI University of Idaho USGBC U.S. Green Building Council Verif. Verification VOC Volatile Organic Compound 3P Third Party Integrated Design Lab | Boise 8 2022 Task 5: - Idaho Power Company External Year-End Report (Report #2022_005-05) 1. Introduction The Energy Resource Library (ERL) is a resource supported by Idaho Power Company (IPC) and managed by the University of Idaho Integrated Design Lab (UI-IDL). The ERL at the UI-IDL is modeled after the Lending Library at the Pacific Energy Center, which is supported by Pacific Gas and Electric (PG&E). The primary goal of the ERL is to help customers with energy efficiency (EE) needs, through the use of sensors and loggers deployed in buildings of various types. Loans are provided to individuals or businesses at no charge to the customer. Over 900 individual pieces of equipment are available for loan through the ERL. The equipment is focused on measuring parameters to quantify key factors related to building and equipment energy use, and factors which can affect worker productivity. The loan process is started when a customer creates a user account. Then the user has access to submit a resource questionnaire and fill out a form describing their intent and project information. Customers can also add tools to their “cart” and complete a checkout process if they don’t require the IDL assistance. When completing a resource questionnaire or the checkout process, the customer includes basic background information, project and data measurement requirements, and goals. When a request is submitted, UI-IDL staff members are alerted of a request via email. The customer and a staff member communicate to verify and finalize equipment needs. An approval email is sent and tools are picked up at the UI-IDL or shipped at the customer’s expense. Integrated Design Lab | Boise 9 2022 Task 5: - Idaho Power Company External Year-End Report (Report #2022_005-05) 2. Marketing Marketing for the ERL was done at various UI-IDL and IPC activities throughout 2022, as well as on the idlboise.com website. The flyer layout was retired during 2019 and replaced with a brochure format. The brochure for the ERL, Figure 1 and 2, reflects the changes to the ERL overall structure for checking out tools and new categories/organization. In addition, a catalog was created that contains the full directory of tools available for check out as well as information about other Idaho Power sponsored programs. It has been distributed at various lectures so firms would have an on-hand reference for the ERL, but also, has been made available as a pdf for download and viewing on the idlboise.com website. You can find the catalog here: http://www.idlboise.com/content/erl-catalog-2022 The ERL was promoted in presentations given by the UI-IDL staff, including the Lunch and Learn series and lectures to professional organizations such as the American Institute of Architects (AIA), ASHRAE, and the City of Boise. The ERL flyer and program slides direct potential users to the ERL website for more information about the library. The main UI-IDL website hosts the ERL portal where customers can submit a resource questionnaire for assistance or a request for specific tools, all online. In 2022, the ERL home page had 2,768 visitors. Changes and progress on the ERL homepage can be found in Appendix B. (http://www.idlboise.com/about-erl) Integrated Design Lab | Boise 10 2022 Task 5: - Idaho Power Company External Year-End Report (Report #2022_005-05) Integrated Design Lab | Boise 11 2022 Task 5: - Idaho Power Company External Year-End Report (Report #2022_005-05) Integrated Design Lab | Boise 12 2022 Task 5: - Idaho Power Company External Year-End Report (Report #2022_005-05) 3. New Tools & Tool Calibration Plan In 2022, sixty-nine new tools were added to the ERL to replace old data logging models, current transformers, and air quality sensors to fill gaps in tool kits, and add accessories for kits. Equipment in the tool loan program typically has a guaranteed calibration period between 1 and 3 years from the manufacturer. While many items may remain within recommended tolerances for years after the guaranteed calibration period ends, verifying the item is properly calibrated after initial and subsequent periods is recommended. Calibration services are available on most tools, sometimes from the manufacturer, and from certified calibration services nationwide. Third party (3P), certified tool calibration is ideal, but an extensive 3P calibration program would be expensive. Based on research and pricing from quotes, formal calibration would be cost prohibitive for much of the library tools. In several cases, cost of calibration can exceed 30% or more of the item’s original cost. As a certified calibration is typically only valid for 1-2 years, an alternative measurement and verification plan for most sensors and loggers is recommended. The management of the ERL has been adapted to integrate the measurement and verification method of calibration. However, a few exceptions to this must be made on a case by case basis to allow for factory calibration of items that cannot be compared or tested in any other way. An example of one item in this category would be the Shortridge Digital Manometer or the Air-Data Multimeter which would have to be recalibrated by the manufacturer. The IDL performs the following to ensure items are within specified calibration tolerances: Integrated Design Lab | Boise 13 2022 Task 5: - Idaho Power Company External Year-End Report (Report #2022_005-05) 1. Equipment is cross-checked against new equipment of the same type for accuracy in a test situation where data is logged. The IDL cross-checks older items against multiple newer items at the end of each calibration period (i.e. every two years) to ensure readings are within specified tolerances. 2. Those items found to be out of tolerance will be assessed for factory re- calibration or replacement. Calibration tracking has been added to the inventory spreadsheet, which allows the IDL to determine which items are due for calibration testing. Updates to calibration and references to testing data is maintained in the inventory spreadsheet and has been expanded to include tool use, quotes, and budget estimates. Integrated Design Lab | Boise 14 2022 Task 5: - Idaho Power Company External Year-End Report (Report #2022_005-05) 4. 2022 Summary of Loans In 2022, loan requests totaled 18 with 16 loans completed, 2 loans are on-going. The first quarter had the highest volume of loans at 7 total. Loans were made to 7 different locations and 6 unique users and 2 new ERL users. A wide range of tools were borrowed, as listed in Figure 8. The majority of tools were borrowed for principle investigations or audits, although loans were also made for determining baselines before EEMs were implemented. Tools were borrowed to verify these EEMs as well. Due to Covid-19 and the associated restrictions there was a decrease in loans over the past year and a half. Continuing into 2023, IDL is devoting resources to market the ERL to potential users in order to return to normal frequency of use. More details about the ERL marketing strategy can be found in the 2023 scope of work. Table 1 and the following figures outline the usage analysis for ERL in 2022. 1/27/2022 Garden City ID Student Identify EEMs 3 2/10/2022 Boise ID University 1 7 2/16/2022 Boise ID Student 2/17/2022 Boise ID University 1 3/7/2022 Boise ID Utility 4 2 3/16/2022 Boise ID University 1 20 3/30/2022 Nampa ID Utility 4 5/12/2022 Meridian ID Company 24 Identify EEMs 1 5/26/2022 Boise ID Company 12 Audit 1 7/22/2022 Boise ID Utility 1 Identify EEMs 2 9/1/2022 Boise ID University 1 Identify EEMs 2 9/9/2022 Boise ID Student 9/12/2022 Boise ID Company 24 Identify EEMs 1 9/13/2022 Boise ID University 1 Identify EEMs 2 10/25/2022 Boise ID Utility 1 12/6/2022 Boise ID Company 30 Integrated Design Lab | Boise 15 2022 Task 5: - Idaho Power Company External Year-End Report (Report #2022_005-05) 12/12/2022 Boise ID University 1 Audit 13 12/12/2022 Boise ID Company 65 Audit 1 Integrated Design Lab | Boise 2022 Task 5: - Idaho Power Company External Year-End Report (Report #2022_005-05) 6 1 1 1 5 2 2 0 2 4 6 8 10 12 14 16 1. Preliminary Investigation / Audit / Study to Identify Energy Efficiency Measures (EEMs) 3. Post-implementation / Verification Measures of Particular EEMs Loans by Type Q1 Q2 Q3 Q4 7 2 5 4 0 1 2 3 4 5 6 7 8 Q1 Q2 Q3 Q4 Number of Loans per Quarter 2022 1 3 3 2 1 4 1 3 0 1 2 3 4 5 Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Number of Loans per Month Total Integrated Design Lab | Boise 2022 Task 5: - Idaho Power Company External Year-End Report (Report #2022_005-05) 12 1 1 1 1 1 1 0 5 10 15 Boise Eagle Meridian New Meadows Murtaugh Grangeville Nampa ID Loans by Location 2022 6 1 3 2 1 1 2 2 0 2 4 6 8 University 1 Company 12 Student Company 24 Company 65 Company 30 Utility 4 Utility 1 Tool Summary 2022 Integrated Design Lab | Boise 2022 Task 5: - Idaho Power Company External Year-End Report (Report #2022_005-05) 0 5 10 15 20 25 Carbon Dioxide and Temperature Monitor CO2 Logger Extech Light Meter Extech Thermo-Anemometer FLEX>US Ultrasound Leak Detector FLIR C2 Portable Thermal Imaging Camera FLIR C3 Portable Thermal Imaging Camera FLIR E50bx Fluke 43B Handheld Instrument Fluke Energy Logger Fluke Infrared Thermometer HOBO U12-012 Data Logger HOBO U12-013 Data Logger HOBO UX100 Thermocouple Logger Konica Minolta Luminance Meter Laser Distance Meter Light Meter w/ Data Logging MX1104 Data Logger Occupancy and Light Data Logger - Narrow Plug Load Data Logger Power Bank Procedures for Commercial Building Energy Audits Sling Psychrometer Temperature Sensor VOC and Temperature Monitor w/ Data Logging, Bapi Tool Summary 2022 Integrated Design Lab | Boise 2022 Task 5: - Idaho Power Company External Year-End Report (Report #2022_005-05) 5. Appendices APPENDIX A: Equipment List The equipment in the library is tracked via excel, website, and in ERL Catalog. The website inventory is organized through several webpages but a complete listing can be found here: http://www.idlboise.com/erl In addition, the ERL Catalog can be found on the idlboise.com website and is available for download here: http://www.idlboise.com/content/erl-catalog-2022 Integrated Design Lab | Boise 2022 Task 5: - Idaho Power Company External Year-End Report (Report #2022_005-05) APPENDIX B: Website Progress The majority of work has shifted to maintenance for website development. Report Number: 2022_001-06 2022 TASK 6: POWER OVER ETHERNET DEMONSTRATION PROJECT IDAHO POWER COMPANY EXTERNAL YEAR-END REPORT December 31, 2022 Prepared for: Idaho Power Company Author: Damon Woods ii This page left intentionally blank. iii Prepared by: University of Idaho Integrated Design Lab | Boise 322 E. Front St., Suite 360, Boise, ID 83702 USA www.uidaho.edu/idl IDL Director: Damon Woods Author: Damon Woods Prepared for: Idaho Power Company Contract Number: IPC KIT # 8112 Please cite this report as follows: Woods, D. (2022). 2022 TASK 6: Power over Ethernet – Demonstration Project (2022_001-06). University of Idaho Integrated Design Lab, Boise, ID. iv DISCLAIMER While the recommendations in this report have been reviewed for technical accuracy and are believed to be reasonably accurate, the findings are estimates and actual results may vary. All energy savings and cost estimates included in the report are for informational purposes only and are not to be construed as design documents or as guarantees of energy or cost savings. The user of this report, or any information contained in this report, should independently evaluate any information, advice, or direction provided in this report. THE UNIVERSITY OF IDAHO MAKES NO REPRESENTATIONS, EXTENDS NO WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO WARRANTIES OF MERCHANTABILITY, AND FITNESS FOR A PARTICULAR PURPOSE WITH RESPECT TO THE INFORMATION, INCLUDING BUT NOT LIMITED TO ANY RECOMMENDATIONS OR FINDINGS, CONTAINED IN THIS REPORT. THE UNIVERSITY ADDITIONALLY DISCLAIMS ALL OBLIGATIONS AND LIABILITIES ON THE PART OF UNIVERSITY FOR DAMAGES, INCLUDING, BUT NOT LIMITED TO, DIRECT, INDIRECT, SPECIAL AND CONSEQUENTIAL DAMAGES, ATTORNEYS’ AND EXPERTS’ FEES AND COURT COSTS (EVEN IF THE UNIVERSITY HAS BEEN ADVISED OF THE POSSIBLITIY OF SUCH DAMAGES, FEES OR COSTS), ARISING OUT OF OR IN CONNECTION WITH THE MANUFACTURE, USE OR SALE OF THE INFORMATION, RESULT(S), PRODUCT(S), SERVICE(S) AND PROCESSES PROVIDED BY THE UNIVERSITY. THE USER ASSUMES ALL RESPONSIBILITY AND LIABILITY FOR LOSS OR DAMAGE CAUSED BY THE USE, SALE, OR OTHER DISPOSITION BY THE USER OF PRODUCT(S), SERVICE(S), OR (PROCESSES) INCORPORATING OR MADE BY USE OF THIS REPORT, INCLUDING BUT NOT LIMITED TO DAMAGES OF ANY KIND IN CONNECTION WITH THIS REPORT OR THE INSTALLATION OF RECOMMENDED MEASURES CONTAINED HEREIN. v This page left intentionally blank. vi TABLE OF CONTENTS 1. Introduction ............................................................................................................................... 1 2. Project Summary ..................................................................................................................... 1 3. Appendix .................................................................................................................................... 3 ACRONYMS AND ABBREVIATIONS BSUG Building Simulation User’s Group IDL Integrated Design Lab IP Internet Protocol IPC Idaho Power Company LED Light Emitting Diode LLLC Luminaire-Level Lighting Controls PoE Power over Ethernet NEEA Northwest Energy Efficiency Alliance Integrated Design Lab | Boise 1 2022 Task 6: Power over Ethernet- Idaho Power Company External Year-End Report (Report #2022_001-06) 1. INTRODUCTION The University of Idaho Integrated Design Lab (UI-IDL) worked to identify a site in Idaho Power territory that is installing Power-over-Ethernet (PoE) lighting. PoE can be configured to work with many low-wattage LEDs and can be addressed by Internet Protocol (IP) for individual control. The PoE infrastructure also increases safety and flexibility by using low-wattage cables that do not require an electrician to re-wire. The IDL intended to function as an independent third party to assess the savings potential of PoE versus high-voltage LED and LLLC combinations. 2. PROJECT SUMMARY The IDL worked on a literature review of the technology and how it compares to conventional lighting. The results were turned into a blog post hosted on the IDL’s Building Simulation User’s Group (BSUG) website. This is included in the appendix. The IDL met with several facility managers and reached out to architects, engineers, and consultants to find a suitable case study site. While one local management company was open to the idea, it is believed that the out-of-pocket costs and electrician’s time were a barrier. The implementation project remains unlikely to move forward without supplemental funding to cover the cost of installation. A new municipal facility located in Ada County (currently in the design stage) is including PoE within their bid set. If the bid comes back favorably from the construction management team, then PoE may be installed at this facility in 2023. The CEO of a regional PoE company is also looking to enter the Idaho market and will contact the IDL if any projects come to fruition. Integrated Design Lab | Boise 2 2022 Task 6: Power over Ethernet- Idaho Power Company External Year-End Report (Report #2022_001-06) Since no case study was found in 2022, only 15% of the budget was used to cover meetings, outreach, and the literature review. If IDL becomes aware of a suitable project for a case study in the future, the lab will coordinate with Idaho Power on a potential scope of work. Integrated Design Lab | Boise 3 2022 Task 6: Power over Ethernet- Idaho Power Company External Year-End Report (Report #2022_001-06) 3. APPENDIX PoE Lighting, The Foundation for Smart Buildings What is PoE Lighting? PoE refers to Power over Ethernet, which is a widely used technology that most of us are accustomed to. Typically, the applications that use power over ethernet are VOIP phones, IP cameras, and wireless access points. The general definition of power over ethernet lighting is lighting systems that are “smart”. While that sounds cool, saying that my lights have the potential to be smart doesn’t really explain anything. A “smart building” is a simple way of saying that the building applications are all connected through an IOT software (Internet of Things), and PoE is a type of hardware that fits into an IOT infrastructure. What does this mean and how does this make buildings “smart”? Well, let’s jump down the rabbit hole of PoE Lighting and learn about it. AC vs DC To begin, a brief history of AC/DC is necessary. AC stands for alternating current, while DC stands for direct current. DC was the type of power that was used by Edison. It is current that runs in one direction, the way power moves in a battery, and doesn’t convert easily into higher or lower voltages. AC, on the other hand, was used by Tesla and reverses in direction multiple times per second and is easily converted to higher or lower voltages. AC Power (Source: FS Community) Integrated Design Lab | Boise 4 2022 Task 6: Power over Ethernet- Idaho Power Company External Year-End Report (Report #2022_001-06) DC Power (Source: FS Community) During the late 1800s, a rivalry between Tesla and Edison took place. Edison had acquired a patent on DC power and began to discredit the AC technology that Tesla was working on as too dangerous to use. He most likely knew that AC was a more efficient way to transport energy but was stuck with his DC patent. In 1893, the Chicago World’s Fair sent out a bid to determine who would get to power the fair. The power company General Electric, using Edison’s DC, bid that they could power the fair for $554,000. George Westinghouse, using Tesla’s AC, bid that he could do it for $399,000 and ultimately got the contract. The attention from the fair led to Westinghouse, who had licensed Tesla’s AC patent, creating a contract with the Niagara Falls Power Company to generate power for the city of Buffalo in 1896. What follows is the use of alternating current to power household appliances like refrigerators, ovens, and dishwashers. Though DC is more stable and is generally safer to transport over long distances, typically our power grids operate in AC. Even though it may seem like AC has the upper hand, much of our new technology uses DC power: electric vehicles, computers, and LED lights to name a few. But since power grids handle energy in AC form, converters are needed to transform the AC from the grid into usable DC that powers our machines. Because of this need of conversion, DC tends to require more infrastructure within a building. Most rectifiers/converters are 90-95% efficient, but that means there is a loss of power during the conversion process. Integrated Design Lab | Boise 5 2022 Task 6: Power over Ethernet- Idaho Power Company External Year-End Report (Report #2022_001-06) (Source: Gainesville Industrial Electric) To transport this energy, we have electrical grids that are made up of power lines that can be high or low voltage lines depending on location and intended use. The same is true for distribution power in buildings but at a much smaller scale (I like to think of this a micro electrical grid). Common methods of distributing power in a building are raceway and conductors, busways, or cable assemblies. However, in the past decade a new method has emerged using ethernet cables and has been coined Power over Ethernet or PoE. Ethernet Ethernet came about when Robert Metcalfe was asked to create a local network that would allow a personal workstation to connect with the first laser printer. The solution needed to Integrated Design Lab | Boise 6 2022 Task 6: Power over Ethernet- Idaho Power Company External Year-End Report (Report #2022_001-06) be able to connect hundreds of computers and run fast enough to keep up with the printer. Metcalfe ended up using a coaxial cable and termed it the ethernet cable for its lightning-fast transmission. It was coined after the archaic physics term “luminiferous ether” which described the medium light traveled through. In the beginning, ethernet was used within closed local network as a way to carry packets of information from computer to computer at 3 megabits per second. This one of several examples of early information technology devices and connecting them via a network by which using packets of data lead to the standardization of information technology languages. After many iterations, wire types, and a patent, ethernet became popular commercially and eventually the standard for data transfer. In 2000, ethernet advanced even more when Cisco developed a version of ethernet that was able to deliver not only data, but power, to phone handsets. It mimicked the way a traditional landline operated and could support 48 volts of DC power, thus allowing one line for a broader range of devices and including a mechanism that protected devices that were not supported by PoE. Overall, PoE had the superior ability to transfer power, the bonus of improved safety, and reduced the number of cables needed which cut down on installation costs. As the commercial markets and industry came to depend on networks of ITDs to efficiently run their operations security concerns began to rise. PoE offered the market a method to power devices and deliver data, thereby, allowing for the option to create a closed network for increased security. Developments to increase the amount of power that could be carried using PoE facilitated the transition of building security infrastructure, such as, cameras and door locks, to utilize PoE. Today, ethernet cables can carry 100 megabits of data per second and can support up to 90 watts. (Source: Circuit Digest) Integrated Design Lab | Boise 7 2022 Task 6: Power over Ethernet- Idaho Power Company External Year-End Report (Report #2022_001-06) PoE Hubs Integrated Design Lab | Boise 8 2022 Task 6: Power over Ethernet- Idaho Power Company External Year-End Report (Report #2022_001-06) You may be asking, “How does PoE actually work?” Basically, a piece of equipment called power sourcing equipment (PSE) supplies DC voltage over ethernet cables to another connected device that’s called a powered device (PD). This connection allows for devices to be powered without a local power source or a separate cable for power. (Source: Vorp Energy) Lighting and PoE Now we ask the question: what if a light fixture could be treated like information technology device? With the ability to deliver power and information over the same wire, would it be possible to connect and power a light fixture through a network? Before we answer that question, let’s review how we have traditionally powered lights and where they are today. Contrary to popular belief, Thomas Edison did not invent the first light bulb. In fact, many scientists were experimenting with electric light over 70 years before Edison joined the stage. In 1802 Humphry Davy created light while experimenting with carbon and an electric battery. Now, this was not anything like the modern bulb and didn’t produce light for very long. Other inventors dabbled in glowing wires over the next few decades, but the next step in lighting technology was in 1840 when Warren de la Rue used a vacuum tube to pass electric current through a platinum wire. While this lasted longer than any previous glowing wire and was effective, the platinum was expensive, and his design couldn’t be mass produced. Integrated Design Lab | Boise 9 2022 Task 6: Power over Ethernet- Idaho Power Company External Year-End Report (Report #2022_001-06) Then, in the 1870s a working light bulb as we recognize it was developed by Joseph Swan, a physicist. This model used carbonized paper filaments and an evacuated bulb but had issues with the vacuum seal and had a short lifetime. In 1874, Henry Woodward and Matthew Evans patented a model that used a similar design as Swan. Woodward and Evans’ model had nitrogen filed glass cylinders and different sizes of carbon rods between the electrodes. The two tried to commercialize their patent but failed, which brings us to the illustrious Edison. The Woodward and Evans patent was then sold to Edison in 1879. And this is where our aforementioned discussion of AC versus DC and Edison versus Tesla comes into play. Since the battle of currents, we have developed a few types of light bulbs including fluorescent, incandescent, mercury vapor, HID, neon, and most recently LED. (Source: Home Depot) LEDs are unique in that they are not technically light bulbs as we know from history. They are actually semiconductors that emit visible light. LEDs, or a light emitting diode, is a diode that contains an anode that passes electricity to a cathode, this transfer of current produces visible light. LEDs behave more like a battery than a traditional light bulb. When considering the voltage of light bulbs, a typical light bulb requires about 110 volts to operate. Some fluorescent bulbs are made to be low voltage, only requiring 12-24 volts. LEDs on the other hand, only take between 1.8 and 3.3 volts, depending on the color and type. Since PoE typically refers to power transfer in watts, let’s convert bulb voltage to wattage: normal bulbs are anywhere from 40-100 watts, low voltage fluorescent bulbs are about 15 watts, and LEDs are typically only 2-10 watts. Integrated Design Lab | Boise 10 2022 Task 6: Power over Ethernet- Idaho Power Company External Year-End Report (Report #2022_001-06) (Source: ResearchGate) (Source: Science ABC) Since they require an extremely low voltage and wattage, LEDs are an ideal candidate for use in a PoE system, allowing then to be classified as an information technology device for its applications. We have already established that PoE can support up to 90W of power, meaning that PoE would be able to power a system of LEDs. We have already touched on how AC and DC differ, and which type of electronics use which type of power. For normal lighting situations, multiple wires, transformers, and hardware are needed to convert power from the grid to power that is used in lighting. When installing or modifying lighting, an electrician is needed because of Integrated Design Lab | Boise 11 2022 Task 6: Power over Ethernet- Idaho Power Company External Year-End Report (Report #2022_001-06) the intensity of the wiring. This makes it expensive and time consuming to change lighting design. PoE infrastructure moves the power conversion and control system upstream to a single unit which makes it safer to change or redesign without an electrician. This also means that each lighting fixture would generate less heat, since no conversion is taking place at the fixture itself, which would allow for a heat sink with a smaller volume. In addition, new materials would be able to be tested as a heat sink which may have not been suitable for lighting before. Lastly, PoE infrastructure uses less wiring which results in a cheaper installation, but also has the potential to make installation easier for electricians which further reduces the cost of installation. The manufacturing of LEDs has the potential to be more efficient and cost effective, since less materials are needed for PoE lighting. New features could also be added if LEDs used PoE. One important hardware component of PoE lighting is LLLC, or Luminaire-Level Lighting Controls. An LLLC is the ability to have embedded sensor during manufacturing, such as, occupancy and ambient light sensors, incorporated into each light fixture. The sensors allow for flexible lighting controls that respond to changing conditions under each fixture. Depending on how many people are inside a room or how much daylight enters the building, the lighting levels will conform accordingly. Pairing with the LLLC allows us to extend the network hardware as well as connect that hardware to our network software for management. More commonly, networks are connected wirelessly using a hub or gateway which allow the input of data from users to be transmitted to the hardware for the desired output or the lighting system responding to users’ commands. Having lighting systems connected with PoE and wireless gateways allows for the utilization of the security and dependability of a closed network while simultaneously giving use the potential to expand or contract our network. Ultimately, if a building’s lighting system is connected to PoE, the lights are deployed in a grid (or microgrid), for commercial applications, throughout the building and each fixture becomes capable of sending and receiving data. This is beneficial since lights are unique in that they are in every building regardless of its age, use, or location. Using commercial lighting as a grid for a central network for buildings would allow for a PoE system that could act as a data highway or backbone for network infrastructure for all the control systems in the building. If this backbone were put in place, it would create a network throughout the entire building, which would mean that other control systems could utilize or be controlled with it. This is what would be called a “smart” environment monitoring system which is where the term “smart building” comes from. There are a couple types of systems that are used to monitor a building’s network. The two main categories of systems are passive and active environment monitoring systems. A passive system looks at the performance of the network as a whole and pulls data from the history of network use. An active system analyzes the network in real time and generates data that determines the current performance. Integrated Design Lab | Boise 12 2022 Task 6: Power over Ethernet- Idaho Power Company External Year-End Report (Report #2022_001-06) Some notable buildings that currently use PoE lighting are DPR Construction in San Francisco, The Edge in Amsterdam, and the Burj Khalifa in Dubai. DPR Construction is the first certified Net Zero Building in San Francisco and includes PoE lighting as one of its green features. The Edge has been called the most intelligent building in the world and is ranked one of the greenest buildings as well. Almost all systems in the building are connected to the grid and it utilizes ethernet as much as possible. The LED lighting systems in this building are one of the highlights that allow it to use as little energy as possible and in the most efficient way. And finally, the Burj Khalifa’s entire façade is lined with LED lights that are programed and controlled by PoE systems. This building uses ethernet in a way that not only shows off current lighting technology to the people inside the building, but to the entire city as well. As we have seen, power over ethernet lighting is utilized in high performing and efficient buildings. But where will we see this technology used first in the US? Most likely we will see it in street grids and traffic lights. The grid networking and lighting used along streets is well suited for a transition to PoE. Some other suitable situations would be school campuses, warehouses, box retails centers, grocery stores, commercial offices, or manufacturing plants. These building types would save lots of energy and would be easily programmable since they all operate on rigid time schedules. Introducing a cohesive PoE lighting system would also provide a network that would act as a backbone for any future system updates. Power over ethernet lighting could be used as an introduction for buildings to transition to a more efficient and effective way to use energy. Integrated Design Lab | Boise 13 2022 Task 6: Power over Ethernet- Idaho Power Company External Year-End Report (Report #2022_001-06) Sources https://www.energy.gov/articles/war-currents-ac-vs-dc-power https://community.fs.com/blog/data-center-power-what-are-ac-and-dc-power-in-data- centers.html http://ffden- 2.phys.uaf.edu/webproj/212_spring_2017/Jacalyn_Morgan/1775941155590410311e3ae/applicati ons-of-ac.html https://www.hpe.com/us/en/insights/articles/the-birth-and-rise-of-ethernet-a-history-1706.html https://www.cisco.com/c/en/us/solutions/enterprise-networks/what-is-power-over-ethernet.html https://www.nvtphybridge.com/power-over-ethernet/ https://www.cisco.com/c/en/us/solutions/enterprise-networks/what-is-poe-lighting.html#~q-a https://www.youtube.com/watch?v=zlXetcO7B38&list=PLURsSHj3SumC2qZIFDZU4xXGNfPxNVVCw&ind ex=5&ab_channel=UIIDLChannel https://kw-engineering.com/pros-cons-power-ethernet-lighting-dc-microgrids/ https://cc-techgroup.com/power-over-ethernet-poe-lighting/ https://www.traditionalbuilding.com/product-report/history- lighting#:~:text=In%20the%20early%201800s%2C%20the,a%20cylinder%20of%20calcium%20oxide. https://www.bulbs.com/learning/history.aspx https://www.wiprolighting.com/blog/how-does-power-over-ethernet-poe-lighting- work#:~:text=The%20PSE%20(power%20sourcing%20equipment,to%20the%20network%20connected% 20devices. https://lightingcontrolsassociation.org/2022/06/15/introduction-to-luminaire-level-lighting-controls/ Report Number: 2022_007-01 2022 TASK 7: LLLC WORKSHOP SUMMARY OF EFFORT AND OUTCOMES IDAHO POWER COMPANY YEAR-END REPORT December 31, 2022 Prepared for: Idaho Power Company Author: Dylan Agnes This page left intentionally blank. Prepared by: University of Idaho Integrated Design Lab | Boise 322 E Front Street, Suite #360 Boise, ID 83702 USA www.uidaho.edu IDL Director: Damon Woods Author: Dylan Agnes Prepared for: Idaho Power Company Contract Number: IPC KIT #8112 Please cite this report as follows: Agnes, D. (2022). 2022 TASK 7: LLLC Workshop – Summary of Effort and Outcomes (2022_003- 01). University of Idaho Integrated Design Lab, Boise, ID. DISCLAIMER While the recommendations in this report have been reviewed for technical accuracy and are believed to be reasonably accurate, the findings are estimates and actual results may vary. All energy savings and cost estimates included in the report are for informational purposes only and are not to be construed as design documents or as guarantees of energy or cost savings. The user of this report, or any information contained in this report, should independently evaluate any information, advice, or direction provided in this report. THE UNIVERSITY OF IDAHO MAKES NO REPRESENTATIONS, EXTENDS NO WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO WARRANTIES OF MERCHANTABILITY, AND FITNESS FOR A PARTICULAR PURPOSE WITH RESPECT TO THE INFORMATION, INCLUDING BUT NOT LIMITED TO ANY RECOMMENDATIONS OR FINDINGS, CONTAINED IN THIS REPORT. THE UNIVERSITY ADDITIONALLY DISCLAIMS ALL OBLIGATIONS AND LIABILITIES ON THE PART OF UNIVERSITY FOR DAMAGES, INCLUDING, BUT NOT LIMITED TO, DIRECT, INDIRECT, SPECIAL AND CONSEQUENTIAL DAMAGES, ATTORNEYS’ AND EXPERTS’ FEES AND COURT COSTS (EVEN IF THE UNIVERSITY HAS BEEN ADVISED OF THE POSSIBLITIY OF SUCH DAMAGES, FEES OR COSTS), ARISING OUT OF OR IN CONNECTION WITH THE MANUFACTURE, USE OR SALE OF THE INFORMATION, RESULT(S), PRODUCT(S), SERVICE(S) AND PROCESSES PROVIDED BY THE UNIVERSITY. THE USER ASSUMES ALL RESPONSIBILITY AND LIABILITY FOR LOSS OR DAMAGE CAUSED BY THE USE, SALE, OR OTHER DISPOSITION BY THE USER OF PRODUCT(S), SERVICE(S), OR (PROCESSES) INCORPORATING OR MADE BY USE OF THIS REPORT, INCLUDING, BUT NOT LIMITED TO, DAMAGES OF ANY KIND IN CONNECTION WITH THIS REPORT OR THE INSTALLATION OF RECOMMENDED MEASURES CONTAINED HEREIN. This page left intentionally blank. TABLE OF CONTENTS Table of Contents ............................................................................................................................ 1 1. Acronyms and Abbreviations ...................................................................................................... 2 2. Introduction ................................................................................................................................ 3 3. 2022 Summary and Cumulative Analysis .................................................................................... 3 2022 Attendance ......................................................................................................................... 4 2022 Evaluations ......................................................................................................................... 5 4. Session Summaries ..................................................................................................................... 6 Session 1: Luminaire Level Lighting Controls & Training – Trial (9/30/22) ................................. 6 Session 2: Luminaire Level Lighting Controls & Training (10/05/22) .......................................... 6 5. Educational Materials ................................................................................................................. 8 6. Case Study/Testimonial LLLC ...................................................................................................... 8 7. Appendices .................................................................................................................................. 9 Appendix A: Luminaire Level Lighting Controls & Training Evaluations ..................................... 9 Integrated Design Lab | Boise 2 1. ACRONYMS AND ABBREVIATIONS AIA American Institute of Architects App Application ASHRAE American Society of Heating, Refrigeration, and Air-Conditioning Engineers CBECS Commercial Building Energy Consumption Survey Comm Commercial Elec. Electrical HVAC Heating, Ventilation, and Air Conditioning IBPSA International Building Performance Simulation Association IDL Integrated Design Lab IPC Idaho Power Company LBNL Lawrence Berkeley National Laboratory LEED Leadership in Energy & Environmental Design LLLC Luminaire Level Lighting Control M. Arch Masters of Architecture ME Mechanical Engineer(ing) Mech. Mechanical MEP Mechanical, Electrical, and Plumbing NCARB National Council of Architectural Registration Boards RDA Revit Daylighting Analysis TMY Typical Meteorological Year UDC Urban Design Center UI University of Idaho USGBC U.S. Green Building Council Integrated Design Lab | Boise 3 2. INTRODUCTION The IDL has installed Luminaire Level Lighting Controls (LLLC’s) in our open office area. These can be configured into different daylighting and occupancy zones. The UI-IDL developed a demonstration workshop for lighting designers and installers. The lab hosted designers and installers for public lectures to view and work with the lighting controls. The IDL provided attendees with impartial information about the performance of the products and how to configure the lighting controls effectively. The 2022 Idaho Power scope of work for the LLLC Training task included planning, organizing and hosting one or two meetings, recording attendance and evaluations, production of education materials including a one-page summary and more detailed sizing report, and a one-page case study/testimonial based on their experiences with LLLC. 3. 2022 SUMMARY AND CUMULATIVE ANALYSIS In 2022, two training sessions were coordinated and hosted. Sessions are summarized below with details in the following sections. Table 1: Overall Summary of Sessions Presenter Company RSVPs Attendees Date Title Presenter In-person In-person 9/30 Luminaire Level Lighting Controls & Training – Trial Dylan Agnes IDL 4 4 15 14 Integrated Design Lab | Boise 4 2022 Attendance Figure 1: Attendee Count by Session and Type Table 2: Overall Attendance Breakdown Architect: 3 Electrician: 0 Engineer: 3 Contractor: 0 Mech. Engineer: 0 Other: 8 Elec. Engineer: 0 None Specified: 0 Total (In-Person): Other: 10 4 0 2 4 6 8 10 12 Luminaire Level Lighting Controls & Training Luminaire Level Lighting Controls & Training - Trial Number of Attendees Figure 2: Attendee Profession Breakdown 22% 21% 57% Architect Engineer Other 100% 0% In Person Online Integrated Design Lab | Boise 5 2022 Evaluations Figure 4: Average Evaluation for 10/05 Training session 4.6 4.8 4.6 4.8 5.0 4.8 3.6 0.0 1.0 2.0 3.0 4.0 5.0 6.0 In general today's presentation was Rate organization Rate clarity Rate opportunity for questions Rate instructor's knowledge of subject matter Rate devlivery of presentation The content of the presentation was Luminaire Level Lighting Controls & Training Integrated Design Lab | Boise 6 4. SESSION SUMMARIES Session 1: Luminaire Level Lighting Controls & Training – Trial (9/30/22) Title: Luminaire Level Lighting Controls & Training Date: 09/30/22 Description: LLLCs have sensors and controls within individual fixtures that enable them to be controlled remotely or on a case-by-case basis. Remote control allows users to adjust the programming criteria or illumination levels without replacing the fixtures. In conventional lighting systems, lighting zones are defined as a collective unit and thus are centrally controlled. LLLCs however, incorporate sensors into each fixture, such as occupancy, daylight, temperature or receive/broadcast signals. Each fixture has the potential to become a semi-autonomous zone that is capable of responding to small changes in the area under each fixture. Furthermore, individual fixtures can communicate with other fixtures, using wireless or infrared signals, to share data for an even greater potential to increase energy savings and user satisfaction. Some LLLCs can be connected by gateway to transfer information collected. This data is analyzed, usually through the manufacturer’s software, to provide a user interface different from a typical text editor. From there users are able to identify trends in occupancy and lighting energy consumption that can then be used to refine the building schedules for occupancy and lighting and, if applicable, for the buildings’ HVAC schedule programming. Presenter: Dylan Agnes Attendance: Architect: Electrician: Engineer: 2 Contractor: Mech. Engineer: Other*: 2 Elec. Engineer: None Specified: Total (In-Person): *If 'Other' was noted: Facility Manager, Utility Program Specialist Session 2: Luminaire Level Lighting Controls & Training (10/05/22) Title: Luminaire Level Lighting Controls & Training Date: 10/05/22 Integrated Design Lab | Boise 7 Description: LLLCs have sensors and controls within individual fixtures that enable them to be controlled remotely or on a case-by-case basis. Remote control allows users to adjust the programming criteria or illumination levels without replacing the fixtures. In conventional lighting systems, lighting zones are defined as a collective unit and thus are centrally controlled. LLLCs however, incorporate sensors into each fixture, such as occupancy, daylight, temperature or receive/broadcast signals. Each fixture has the potential to become a semi-autonomous zone that is capable of responding to small changes in the area under each fixture. Furthermore, individual fixtures can communicate with other fixtures, using wireless or infrared signals, to share data for an even greater potential to increase energy savings and user satisfaction. Some LLLCs can be connected by gateway to transfer information collected. This data is analyzed, usually through the manufacturer’s software, to provide a user interface different from a typical text editor. From there users are able to identify trends in occupancy and lighting energy consumption that can then be used to refine the building schedules for occupancy and lighting and, if applicable, for the buildings’ HVAC schedule programming. Presenter: Dylan Agnes Attendance: Architect: 3 Contractor: Engineer : Electrician: Mech. Engineer: Other*: 7 Elec. Engineer: None Specified: Total (In-Person): *If 'Other' was noted: Facilities Manager, Industry Representative, Code Specialist Integrated Design Lab | Boise 8 5. EDUCATIONAL MATERIALS The IDL developed a forty page booklet describing Luminaire Level Lighting Controls with the intent of explaining the upcoming technology to building owners or operators as well as professionals in the Architecture, Engineering, and Construction industry. The booklet covers a technology overview, potential impact to the industry, energy and cost, best practices or use, and common lighting terminology. The format of the booklet was organized so that a handful of topics, such as, Luminaire Level Lighting Controls, Network Lighting Controls, Network Topography, and Changing the Game are ‘spreads’. Spreads, in the graphic design sense, refers to a set of pages, usually two, to be viewed together. Therefore, each of these sections can be pulled from the booklet and used separately for marketing or educational purposes. Participants in the LLLC Training were provided a copy of the LLLC Technology booklet, a workbook, and two product catalogs of the LLLCs the IDL has installed at our offices (Cooper Lighting Solutions). Moving forward the LLLC Technology booklet is available upon request and has not been added to the IDL’s website. 6. CASE STUDY/TESTIMONIAL LLLC As of 12/31/22 there have been no documented projects that have utilized the New Construction and Major Renovation Incentive Program L3 incentive. The L3 incentive specifically deals with LLLC and pulling projects from this category would ensure that projects are within Idaho Power territory. However, the IDL was able to potentially find a candidate through the training session given on the 5th of October. Integrated Design Lab | Boise 9 7. APPENDICES Appendix A: Luminaire Level Lighting Controls & Training Evaluations Summaries of evaluations for each of the two sessions are recorded below. It should be noted that the first session was conducted as a trial run for Idaho Power and a property management firm. Feedback for that session was documented in an informal manner and implemented during the session or immediately following the conclusion of the session. Session 1 (09/30/22): Luminaire Level Lighting Controls & Training – Trial Presentation Info: Date: 09/30/22 Location: Idaho Water Center – Boise, ID Presenters: Dylan Agnes – IDL Attendance: 4 Evaluations: No evaluations were collected. Scale 0.0 0.0 0.0 0.0 0.0 0.0 0.0 Session 2 (10/05/22): Luminaire Level Lighting Controls & Training Presentation Info: Date: 04/27/2022 Integrated Design Lab | Boise 10 Location: Idaho Water Center – Boise, ID Presenter: Dylan Agnes – IDL Attendance: Architect: 3 Electrician: Engineer: Contractor: Mech. Engineer: Other*: 7 Elec. Engineer: None Specified: Total (In-Person): 10 *If 'Other' was noted: Facilities Manager, Code Specialist, Industry Representative Evaluations: Scale In general, today's presentation was: 4.6 1 Not Useful - 5 Very Useful 4.8 1 Needs Improvement - 5 Excellent 4.6 1 Needs Improvement - 5 Excellent 4.8 1 Needs Improvement - 5 Excellent 5.0 1 Needs Improvement - 5 Excellent 4.8 1 Needs Improvement - 5 Excellent 3.6 Comments: Attendee Suggested Improvements for the Instructor: • • None Needed • Good Presentation, Possibly slow down a bit • Tad bit monotone, get excited! What attendees found most valuable: Explanation on occupancy and vacancy settings • System capability • Opportunity for future trainings • I learned more about smart buildings and integration of lighting systems • New tech, up and coming systems Professional Associations of Which Attendees are Members: AIA, BOC, NCQLP, IES Report Number: 2022_003-01 2022 TASK 8: DIGITAL DESIGN TOOLS SUMMARY OF EFFORT AND OUTCOMES IDAHO POWER COMPANY INTERNAL YEAR-END REPORT December 31, 2022 Prepared for: Idaho Power Company Author: Dylan Agnes This page left intentionally blank. Prepared by: University of Idaho Integrated Design Lab | Boise 322 E Front Street, Suite #360 Boise, ID 83702 USA www.uidaho.edu IDL Director: Damon Woods Author: Dylan Agnes Prepared for: Idaho Power Company Contract Number: IPC KIT #V Please cite this report as follows: Agnes, D. (2022). 2022 TASK 8: Digital Design Tools – Summary of Effort and Outcomes (2022_003-01). University of Idaho Integrated Design Lab, Boise, ID. DISCLAIMER While the recommendations in this report have been reviewed for technical accuracy and are believed to be reasonably accurate, the findings are estimates and actual results may vary. All energy savings and cost estimates included in the report are for informational purposes only and are not to be construed as design documents or as guarantees of energy or cost savings. The user of this report, or any information contained in this report, should independently evaluate any information, advice, or direction provided in this report. THE UNIVERSITY OF IDAHO MAKES NO REPRESENTATIONS, EXTENDS NO WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO WARRANTIES OF MERCHANTABILITY, AND FITNESS FOR A PARTICULAR PURPOSE WITH RESPECT TO THE INFORMATION, INCLUDING BUT NOT LIMITED TO ANY RECOMMEDATIONS OR FINDINGS, CONTAINED IN THIS REPORT. THE UNIVERSITY ADDITIONALLY DISCLAIMS ALL OBLIGATIONS AND LIABILITIES ON THE PART OF UNIVERSITY FOR DAMAGES, INCLUDING, BUT NOT LIMITED TO, DIRECT, INDIRECT, SPECIAL AND CONSEQUENTIAL DAMAGES, ATTORNEYS’ AND EXPERTS’ FEES AND COURT COSTS (EVEN IF THE UNIVERSITY HAS BEEN ADVISED OF THE POSSIBLITIY OF SUCH DAMAGES, FEES OR COSTS), ARISING OUT OF OR IN CONNECTION WITH THE MANUFACTURE, USE OR SALE OF THE INFORMATION, RESULT(S), PRODUCT(S), SERVICE(S) AND PROCESSES PROVIDED BY THE UNIVERSITY. THE USER ASSUMES ALL RESPONSIBILITY AND LIABILITY FOR LOSS OR DAMAGE CAUSED BY THE USE, SALE, OR OTHER DISPOSITION BY THE USER OF PRODUCT(S), SERVICE(S), OR (PROCESSES) INCORPORATING OR MADE BY USE OF THIS REPORT, INCLUDING BUT NOT LIMITED TO DAMAGES OF ANY KIND IN CONNECTION WITH THIS REPORT OR THE INSTALLATION OF RECOMMENDED MEASURES CONTAINED HEREIN. This page left intentionally blank. TABLE OF CONTENTS Table of Contents ............................................................................................................................ 1 1. Acronyms and Abbreviations ...................................................................................................... 3 2. Introduction ................................................................................................................................ 4 3. Design Tools ................................................................................................................................ 4 2022 Summary of Work .............................................................................................................. 5 2022 New Design Tools ............................................................................................................... 5 Covid Impact Modeling ............................................................................................................ 5 4. Design Tool Summaries ............................................................................................................... 6 CBECS Data Visualization Infographics ........................................................................................ 6 CBECS Micro Master v2 ............................................................................................................... 7 Weather Normalization ............................................................................................................... 7 EnergyPlus Fan Energy Calculator ............................................................................................... 8 LM-83 Three-Phase Daylight Simulation Script ........................................................................... 8 Infiltration Equations & Conversions .......................................................................................... 9 The Climate Responsive Design Web Tool Sets ........................................................................ 10 Climate Design Resources – 1st & 2nd Generation Tool Sets ..................................................... 10 Thermal Energy Savings Tabulator (TEST) ................................................................................. 12 Construction Insulation Value Calculator.................................................................................. 12 Sustainable Design & Practice Benefits ..................................................................................... 13 Daylight Pattern Guide .............................................................................................................. 14 5. Design Tools Maintenance ........................................................................................................ 14 CBECS Data Visualization Infographics ...................................................................................... 14 CBECS Micro Master v2 ............................................................................................................. 15 Weather Normalization ............................................................................................................. 15 EnergyPlus Fan Energy Calculator ............................................................................................. 15 LM-83 Three-phase Daylight Simulation Script......................................................................... 15 Infiltration Equations & Conversions ........................................................................................ 15 The Climate Responsive Design Web Tool ................................................................................ 15 Integrated Design Lab | Boise 2 Climate Design Resources - 1st & 2nd Generation Tool Sets ................................................... 15 Thermal Energy Savings Tabulator (TEST) ................................................................................. 15 Construction Insulation Value Calculator.................................................................................. 15 Sustainable Design & Practice Benefits ..................................................................................... 16 Daylight Pattern Guide .............................................................................................................. 16 6. Design Tools Statistics ............................................................................................................... 16 7. Future Work & Design Tools ..................................................................................................... 16 Developing Guides/How-to for Design Tools ............................................................................ 16 Indoor Air Quality ...................................................................................................................... 17 Integrated Design Lab | Boise 3 1. ACRONYMS AND ABBREVIATIONS AIA American Institute of Architects App Application ARUP London based multi-discipline firm ASHRAE American Society of Heating, Refrigeration, and Air-Conditioning Engineers BCVTP Building Controls Virtual Test-Bed BEMP Building Energy Modeling Professional BESF Building Energy Simulation Forum (Energy Trust of Oregon) BIM Building Information Modeling BOMA Building Owners and Managers Association BSME Bachelor of Science in Mechanical Engineering BSUG Building Simulation Users’ Group CBECS Commercial Building Energy Consumption Survey Comm Commercial Elec. Electrical HePESC Heat Pump Energy Savings Calculator HVAC Heating, Ventilation, and Air Conditioning IBPSA International Building Performance Simulation Association IDL Integrated Design Lab IPC Idaho Power Company LBNL Lawrence Berkeley National Laboratory LEED Leadership in Energy & Environmental Design LLLC Luminaire Level Lighting Control M. Arch Masters of Architecture ME Mechanical Engineer(ing) Mech. Mechanical MEP Mechanical, Electrical, and Plumbing MS Arch Masters of Science Architecture NCARB National Council of Architectural Registration Boards RDA Revit Daylighting Analysis TMY Typical Meteorological Year UDC Urban Design Center UI University of Idaho USGBC U.S. Green Building Council Integrated Design Lab | Boise 4 2. INTRODUCTION Over the years, the Integrated Design Lab has developed several digital design tools to assist local firms. These include ventilation calculators, daylighting methodologies, thermal envelope calculators, and climate visualization assistants. These tools have been collected and hosted on the IDL website in 2021 but some require updating. IDL is working to update these tools to the latest design temperatures (which have increased over time) and link to other tools available to designers so that the IDL website can serve as a one-stop resource for local engineers and architects for early design considerations. 3. DESIGN TOOLS In 2022, twelve design tools were available for use and download. The Design Tools are summarized below. Table 1: Design Tools High Integrated Design Lab | Boise 5 2022 Summary of Work Design tools were assigned a priority during the initial proposal of the task. A design tool’s priority determines the probability of receiving an update for the current year. In the future, a design tool’s priority level will be assessed in the kick-off meeting for the project task. For 2022, high priority was assigned to two design tool: CBECS Data Visualization Infographics and CBECS Micro Master v2. Commercial Building Energy Consumption Survey (CBECS) 2018 data was expected to be released in 2020, however, the COVID-19 pandemic has continually delayed the release of data from the study. An update in August 2022 indicated that the complete study, including micro data, would be released to the public in the fourth quarter of 2022. With the highest priority given to the CBECS design tools it was agreed that the IDL would begin work on medium-high priority tools but reserve any remaining hours in case CBECS data would be released in 2022. Therefore, the majority of work conducted for this task has occurred in late November and will continue until the end of December. As of 12/14/22, we have downloaded CBECS 2018 data and are working on parsing out the data so it can be formatted for analysis as well as visualization. This will continue until the end of December with the intent of having as much data as possible be prepared for visualization work starting next year, 2023. 2022 New Design Tools Covid Impact Modeling Sponsored by the Idaho Power Company, the University of Idaho Integrated Design Lab (UI-IDL) developed a series of infographics to communicate how COVID-19 has brought the issue of indoor air quality to the forefront of building science. Virus mitigation strategies range Integrated Design Lab | Boise 6 in effectiveness, efficiency, and costs depending on the building type, use types, and local climate. Using Open Studio and Energy+, the IDL examined the energy and cost impacts of six different mitigation strategies for commercial buildings in the Treasure Valley. • HEPA Induct • HEPA Portable • MERV • NPBI • Outdoor Air • UVGI Induct • UVGI Upper Room 4. DESIGN TOOL SUMMARIES CBECS Data Visualization Infographics Priority: High Link: http://idlboise.com/content/cbecs-data-visualization-infographics Description: Sponsored by the Idaho Power Company, the University of Idaho Integrated Design Lab (UI- IDL) developed this series of infographics to communicate how four different building types consume energy on both a regional and national level. The data used to create them has been gathered from The Commercial Buildings Energy Consumption Survey (CBECS), which is a national-level sample survey of commercial buildings and their energy suppliers conducted quadrennially by the Energy Information Administration (EIA). The survey collects key benchmark information on U.S. commercial buildings, their characteristics, and how they consume energy. It is used by private and public stakeholders to track industry progress and gain a high-level understanding of how similar buildings compare and inform policy decisions. Architects and engineers can also use this information for goal setting and prioritizing energy efficiency measures within the integrated design process for high performance projects. These infographics make detailed consumption data per building type easily accessible to design teams without having to filter the CBECS database themselves. Information from CBECS is reported on the EIA’s website in the form of summary tables, which provide tabular breakdowns of high-level energy consumption statistics based upon general building characteristics. The information is also available as public use microdata spreadsheets that can be downloaded, filtered, and organized with much more flexibility than the summary tables. These spreadsheets contain much more detailed information from the building characteristics survey in its entirety and served as the origin of information for this series of infographics. Integrated Design Lab | Boise 7 Currently, there are five double-sided 11x17" infographics. The first is an introduction to the project and the CBECS database. The next four delve specifically into the office, retail, education and lodging building type. Last updated: 2021 CBECS Micro Master v2 Priority: High Link: N/A Description: This file contains a good portion of the CBECS microdata, which can be filtered for benchmarking and goal setting functions. Last updated: 2021 Weather Normalization Priority: Medium-High Link: http://www.idlboise.com/content/weather-normalization Description: This spread sheet was created in order to aid with the processing and analysis of building energy usage. In order to operate this spread sheet you will need the following bills for each month in the period you wish to analyze: • Natural Gas • Electricity • Geothermal (if applicable) In addition, weather data for the location of project is needed. This information can be obtained from the provided link with the instructions below. • NOAA National Weather Service • Select the nearest data center. • Go to the NOWData Tab and refine the location if needed. • Under the "Product" select "Monthly Summarized Data". • Input the desired range of years. • Set the "variable" drop down to either CDD or HDD. • Click go and copy data to the Data Entry tab of this file. Integrated Design Lab | Boise 8 The sheet will automatically calculate actual and expected energy usage and create graphs that can be found in the "Output Figures" tab. More detailed analysis can be found in the "Calculated Values" and "Regression Visualization" tabs. Last updated: 2021 EnergyPlus Fan Energy Calculator Priority: Medium-High Link: http://idlboise.com/content/energyplus-fan-energy-calculator Description: This spreadsheet was created in order to aid with determining the fan inputs into EnergyPlus via equations from ASHRARE 90.1 Appendix G (for baseline systems) and fan specifications (for proposed systems). Three key inputs are needed in EnergyPlus: • Supply Fan Total Efficiency • Supply Fan Delta Pressure {Pa} • Supply Fan Motor Efficiency In order to calculate these inputs, this spreadsheet will lead you through a series of steps, depending on the system type required for your building type. The tabs of this spreadsheet are as follows: • Introduction • Systems 1 & 2 • Systems 3 & 4 • Systems 5 - 8 • Proposed System • Resources Colored cells signify inputs, outputs, links, and instructive text. Last updated: 2021 LM-83 Three-Phase Daylight Simulation Script Priority: Medium-High Link: http://idlboise.com/content/lm-83-12-three-phase-daylight-simulation-script Description: Annual simulation of dynamic/complex fenestration systems under LM-83 guidelines. This script will generate its own folder structure beyond the starting directories required, which are outlined below. Version 1.2.0 (August 25, 2017) Integrated Design Lab | Boise 9 Author: Alen Mahic, Ery Djunaedy (Energy Studies in Buildings Laboratory University of Oregon; Integrated Design Lab University of Idaho) This work is licensed under the Creative Commons Attribution 3.0 Unported License. To view a copy of this license, visit GPL v.3 In plain English: you are free to use this script, distribute it, make changes to it, as long as (1) you acknowledge Alen Mahic, Ery Djunaedy and the Integrated Design Lab as the original authors, and (2) you acknowledge that the script is provided as-is with absolutely no warranty, and that the authors and the University of Idaho are not liable to anything that happens or does not happen in relation to the use of this script. Radiance 5.0+ is required. Last updated: 2022 Infiltration Equations & Conversions Priority: Medium Link: http://idlboise.com/content/infiltration-equations-conversions-0 Description: A key factor in building heat gain and loss may be the infiltration rate, or the rate at which outdoor air is exchanged with conditioned interior air through the envelope. This spreadsheet tool outlines a set of simplified equations aimed at converting typical, real world infiltration measurements into metrics that can be input into EnergyPlus. In using methods outlined in the document Infiltration Modeling Guidelines for Commercial Building Energy Analysis by the Pacific Northwest National Laboratory, we were able to convert common metrics of I75 and ACH50, into ones that could be conveniently input into an Energy Plus Model (Idesign and ACHnat). NOTE: At this time, this calculation tool does not take into account infiltration from stack pressure, only horizontal wind pressure. Key Definitions • ACH50-The number of complete air changes that occur within an hour when the building is pressurized at 50 Pascals. This metric is usually used in residential infiltration measurement. • ACHnat-The number of natural air changes that occur with an hour when the building is naturally pressurized. • I75- The infiltration flow rate of air in cubic feet per minute per square foot of exterior exposed surface area when the building is pressurized at 75 Pascals. This metric is more commonly used in commercial infiltration measurement. • Idesign- The infiltration flow rate of air in cubic feet per minute per square foot of exterior exposed surface area when the building is naturally pressurized. Spreadsheets Integrated Design Lab | Boise 10 • Spreadsheets 1 and 2 can be used to convert I75 into Idesign. Spreadsheet "1. I75 to Idesign Text," explains the method and equations for the conversion. "2. I75 to Idesign Calculations," is an interactive spreadsheet that takes your project's input and provides an output that can be used in EnergyPlus. • Spreadsheets 3 and 4 can be used to convert ACH50 into ACHnat. As in spreadsheets 1-2, "3. ACH50 to ACHnat Text," explains the method and equations for the conversion. "4. ACH50 to ACHnat Calculations," is an interactive spreadsheet that takes your project's input and provides an output that can be used in EnergyPlus. • Spreadsheets 5 and 6 are for comparing ACH50 into Idesign metrics. As in spreadsheets 1-4, "5. Compare ACH and I Text," explains the method and equations for the conversion. "6. Compare ACH to I Calculation," is an interactive spreadsheet that takes your project's input and provides an output of comparisons between the different metrics. • Spreadsheet 7 is a provides a reverse calculation. "7. Reverse Calcs" allows you to convert from an EnergyPlus input into I75. • Spreadsheet 8 is a reference tab. "8. Appendix" contains useful reference charts for spreadsheets 1-7. Last updated: 2021 The Climate Responsive Design Web Tool Sets Priority: Medium Link: http://idlboise.com/content/climate-responsive-design-web-tool Description: The Climate Responsive Design web tool is designed to graphically illustrate the feasibility and potential energy benefits of several climate responsive design strategies. The tool is intended to help designers and owners make correct early decisions that will result in buildings that are more energy efficient. The output of the tool are graphic data plots designed to illustrate not only conventional climate data, such as temperature and relative humidity, but also more complex interactions of these raw weather data with building specific user input data and a rule set for various energy efficient design strategies. The Climate Responsive Design web tool requires viewing in Firefox internet browser. Last updated: 2021 Climate Design Resources – 1st & 2nd Generation Tool Sets Priority: Medium Link: http://idlboise.com/content/ui-idl-climate-design-resources-1st-2nd-generation-tool-sets Description: The Idaho Power Company funded the University of Idaho Integrated Design Lab (UI-IDL) to produce a series of climate design resources to help assist in the conceptual and early design of passive Integrated Design Lab | Boise 11 strategies. Through their support, the UI-IDL has developed two generations of spreadsheet calculators that are capable of analyzing building loads and energy consumption impacts of a range of different design strategies over three reference cities. You can download the tools and both the 1st and 2nd generation research reports at the bottom of this webpage. The reports provide insight into the methodology of the research used to develop the tools as well as information on how to use them most effectively. Currently, there are seven different calculation spreadsheets that span across two different generations of tool development: FIRST GENERATION TOOLS • Heat Gain Calculations • Cross Ventilation • Stack Ventilation • Night Ventilation Thermal Mass SECOND GENERATION TOOLS • Balance Point Calculation • Passive Solar • Earth Tube Each spreadsheet contains multiple tabs and a step-by-step process that directs the user to define the critical baseline and performance parameters of the building. These factors are linked to pre-defined equations within the spreadsheet that automatically provide the peak cooling loads, cooling capacities, and describe other critical design criteria. Charts, line graphs, and other forms of graphic information also automatically populate the workspace to provide rich visual feedback to the user. The spreadsheets also contain a reference tab that consolidates a myriad of textbook, code, and other sources needed to complete the step-by-step instructions. Additionally, a variety of weather data, including hourly information from TMY weather files, are embedded into the calculations based upon three different reference cities within the Idaho Power Company service territory. Once each tab is filled out, the results pages of the spreadsheets contains all of the important outputs needed to evaluate how much the passive design measure can contribute to the peak loads or energy savings of the building. Changes to the building parameters are instantaneous, making the Climate Tools Package an ideal instrument used to explore different design iterations and how they might facilitate passive design strategies. Goals The ultimate goal of the Climate Tools Package is to reduce the loads and energy consumption of a building through passive design measures. This happens mainly by embedding, early in the design process, the analysis of the performance capabilities of different passive cooling and heating strategies. Once a performance capacity is calculated and compared against peak loads of a building, a qualitative decision can be made whether or not to pursue more detailed analysis. If certain passive strategies are proven to meet some or all of the peak load, this may warrant further development. Potential next steps Integrated Design Lab | Boise 12 could involve more advanced analysis such as building simulation to quantify annual energy savings based on actual weather data. Last updated: 2021 Thermal Energy Savings Tabulator (TEST) Priority: Medium Link: http://www.idlboise.com/content/thermal-energy-savings-tabulator-test Description: This tool aims to provide designers, engineers, and manufacturers a quick and easy way to calculate energy savings from the application of different heat pump HVAC technologies early in the design process. Specifically, the tool supports analysis of air-source heat pumps (ASHP), water-source heat pumps (WSHP), and variable refrigerant flow (VRF) systems. The spreadsheet was developed by the University of Idaho Integrated Design Lab (UI-IDL) with funding from Idaho Power Company. To learn more about the development of the tool, please visit the UI-IDL’s website here - idlboise.com. The tool provides the means for detailed input of a custom building, geometry, and program, while using pre-cooked, whole-building simulations to aid in HVAC energy calculations. The tool always compares a baseline condition to a proposed condition. The baseline condition can represent a new construction code baseline, or could be used to define an existing building. The spreadsheets contain color coded cells that represent different functionalities. All cells, except for those that require user input, are locked to avoid confusion. However, the cells can be unlocked without a password for custom manipulation or for further insight into equations used for calculations. See below for the various cell's color-coded instructions and their specific descriptions: Last updated: 2021 Construction Insulation Value Calculator Priority: Low Link: http://idlboise.com/content/construction-insulation-value-calculator Description: This spreadsheet is designed to calculate insulation values of individual material layers and whole constructions of EnergyPlus objects. Last updated: 2021 Integrated Design Lab | Boise 13 Sustainable Design & Practice Benefits Priority: Low Link: http://idlboise.com/content/sustainable-design-practice-benefits Description: Sponsored by the Idaho Power Company, the University of Idaho Integrated Design Lab (UI- IDL) developed this series of infographics to communicate sustainable design & practice Benefits of five different building types for their bottom line impact on efficiency for each building type. Architects and engineers can also use this information to make early design decisions with compelling numbers for additional non-energy benefits of energy efficient design. Currently, there are five printable, single-sided 8.5X11" infographics describing specific benefits and strategies for Grocery, Hotel, Multi-family Housing, Office, and Retail building types. EXPECTED BENEFITS • Broadening the scope of sustainable design effectiveness beyond simple utility cost payback gives a more accurate picture of the financial benefits available through sustainable design • Strategies for specific occupancy types highlight the solutions that are most effective and easiest to achieve for each unique set of needs. Efficiency tips for additional building types can be found at Idahopower.com/business • Better information during the design phase means a more accurate prediction of a building’s performance, avoiding costly changes down the road • Readily available and easily understandable information means increased participation in efficiency programs by designers, employees, and users of a space • Energy strategies that go beyond building design and highlight savings opportunities in day to day operation mean greater energy savings with minimal cost • Sustainable design and responsible energy consumption can increase a user’s comfort and appreciation, leading to more positive user experiences and an increase in community support and interaction • Power companies offer financial incentives to help offset the costs of implementing sustainable design strategies. Available for new construction, retrofits, custom projects, and flex peak programs, Idaho Power helps to make it more affordable than ever to incorporate sustainable and energy-efficient design decisions into your project. Additional information on Idaho Power incentive programs can be found at Idahopower.com/business BOTTOM LINE Energy and cost savings attributed to efficiency measures are well documented. However, with additional opportunities to increase comfort, efficiency, community involvement, and customer satisfaction, sustainable design and practice could have an impact on your bottom line far beyond reduced utility bills. Last updated: 2021 Integrated Design Lab | Boise 14 Daylight Pattern Guide Priority: Low Link: http://idlboise.com/content/cbecs-data-visualization-infographics Description: The Daylighting Pattern Guide is the newest offering in the Advanced Buildings suite of tools and resources to help design teams create high performance commercial buildings. This no-cost, interactive design tool uses a combination of real-world built examples and advanced simulation to set the stage for substantial reductions in lighting power consumption and overall building energy use. It was developed through a partnership between New Buildings Institute (NBI), University of Idaho and University of Washington. High quality daylighting design has the potential to increase user satisfaction and productivity and save substantial energy. However, successfully designing daylighting into buildings in a manner that supports high ratings of visual comfort while also saving energy can be a complex and challenging process. The Daylighting Pattern Guide presents 19 prime examples of well-designed daylit spaces around the United States. Each project was photographed, physically measured and simulated using the Radiance simulation tool. Sensitivity analysis of key design variables was conducted on each project to demonstrate whether the outcome was optimized and to illustrate the impact of multiple ‘alternate design decisions’ on the daylighting performance. Key daylight patterns, or variables including orientation, glazing layout, area, shading strategies, furniture layout, ceiling height, that contribute to the success or failure of a daylighting design were also identified. This information allows users to differentiate between good built examples of daylit space, the information generated by design analysis tools, and the ‘rule of thumb’ guidelines that designers commonly apply. Project types included in analysis are offices, schools, libraries, laboratories, museums, industrial facilities, and recreational facilities across a diverse set of regional climates. Last updated: 2021 5. DESIGN TOOLS MAINTENANCE CBECS Data Visualization Infographics None to date. Integrated Design Lab | Boise 15 CBECS Micro Master v2 None to date. Weather Normalization Reviewed, cataloged, and ready for updates. EnergyPlus Fan Energy Calculator Reviewed, cataloged, and ready for updates. LM-83 Three-phase Daylight Simulation Script Reviewed, cataloged, and no updates needed. Infiltration Equations & Conversions None to date. The Climate Responsive Design Web Tool None to date. Climate Design Resources - 1st & 2nd Generation Tool Sets None to date. Thermal Energy Savings Tabulator (TEST) None to date. Construction Insulation Value Calculator None to date. Integrated Design Lab | Boise 16 Sustainable Design & Practice Benefits None to date. Daylight Pattern Guide None to date. 6. DESIGN TOOLS STATISTICS We saw a total of 2,812 visits to the home/landing page for the digital design tools (http://www.idlboise.com/content/design-tools). The table below shows the number of visits to a design tools page. Priority Name Page Visits High 7. FUTURE WORK & DESIGN TOOLS Developing Guides/How-to for Design Tools While most design tools include an introduction or instructions to assist users with using the tool we don’t have any examples or tutorials they can reference. An example or tutorials would include using the tool, when to use the tool, and when not to use the tool. Integrated Design Lab | Boise 17 Indoor Air Quality Energy efficient indoor air quality tool that utilizes data and research accumulated through the 2021 IAQ task. This tool will have drop- down menus for baseline and proposed methods along with manual entry fields as needed to reasonably estimate kWh/yr usage and costs for the most popular configurations. The tool will utilize current IPC rate schedules to provide potential bill savings and payback years. Supplement 2: Evaluation Demand-Side Management 2022 Annual Report Page 201 RESEARCH/SURVEYS Report Title Sector Analysis Performed By Study Manager Study/Evaluation Type 2022 Flex Peak Non-Participant Survey Results Commercial/ Industrial Idaho Power Idaho Power Survey 2022 Flex Peak Participant Survey Commercial/Industrial Idaho Power Idaho Power Survey 2022 Idaho Power WAQC Customers Program Survey Residential Idaho Power Idaho Power Survey 2022 Idaho Power Weatherization Solutions for Eligible Customers Program Survey Residential Idaho Power Idaho Power Survey 2022 Peak Rewards Non-Participant Survey Irrigation Idaho Power Idaho Power Survey 2022 Peak Rewards Participant Survey Irrigation Idaho Power Idaho Power Survey 2022 Retrofits Program Survey Results Commercial/Industrial Idaho Power Idaho Power Survey 2022 SBDI Non-Respondent Follow Up Survey Results Commercial/Industrial Idaho Power Idaho Power Survey 2022 SBDI Program Customer Satisfaction Survey Reponses Commercial/Industrial DNV DNV Survey 2022 Shade Tree Program Survey Results Residential Idaho Power Idaho Power Survey Supplement 2: Evaluation Page 202 Demand-Side Management 2022 Annual Report Answer Percent Response 24.00%6 8.00%2 16.00%4 8.00%2 44.00%11 Total 25 Answer Percent Response Food manufacturing 18.52%5 Grocery 0.00%0 Office - Large 7.41%2 Office - Small 14.81%4 Retail 3.70%1 School/University 14.81%4 Warehouse 11.11%3 Water/Wastewater 3.70%1 Other (please specify)25.93%7 Total 27 Answer Percent Response Fixed incentive too small 3.70%1 Variable incentive too small 0.00%0 Wasn't beneficial this year 3.70%1 Events too late in the day 3.70%1 Too many events in the season 3.70%1 Events too close together 0.00%0 Negative impact to the business 29.63%8 Did not know about the program 51.85%14 Other (please specify)3.70%1 Total 27 Other (please specify) Which best describes your reason for not participating in the Flex Peak program?(Check all that apply) What industry best describes your company?(If your company has multiple offices/locations, check all that apply.) 2022 Flex Peak Rewards Non Participant Survey Results Facilities Director/Manager/Supervisor Maintenance Director/Manager/Supervisor Operations Director/Manager/Supervisor Plant Director/Manager/Supervisor What is your role at your company? Answer Percent Response Very familiar 0.00%0 Moderately familiar 8.00%2 Somewhat familiar 12.00%3 Slightly familiar 16.00%4 Not familiar at all 64.00%16 Total 25 Answer Percent Response Very satisfied 0.00%0 Somewhat satisfied 0.00%0 Neither satisfied nor dissatisfied 100.00%5 Somewhat dissatisfied 0.00%0 Very dissatisfied 0.00%0 Total 5 Answer Percent Response Very satisfied 0.00%0 Somewhat satisfied 0.00%0 Neither satisfied nor dissatisfied 100.00%5 Somewhat dissatisfied 0.00%0 Very dissatisfied 0.00%0 Total 5 Answer Percent Response Very satisfied 0.00%0 Somewhat satisfied 0.00%0 Neither satisfied nor dissatisfied 100.00%5 Somewhat dissatisfied 0.00%0 Very dissatisfied 0.00%0 Total 5 Answer Percent Response Very satisfied 0.00%0 Somewhat satisfied 0.00%0 Neither satisfied nor dissatisfied 100.00%5 Somewhat dissatisfied 0.00%0 Very dissatisfied 0.00%0 Total 5 How familiar are you with the Flex Peak program's incentive payment structure? How satisfied are you with the following components in the Flex Peak program incentive payment structure? Incentive adjustment of $2/kW per hour of nomination not met during an event Actual load reduction calculation during an event Weekly fixed incentive of $3.25/kW nominated Variable payment after the 4th event of $0.20/kWh Answer Percent Response Very likely 12.00%3 Somewhat likely 20.00%5 Neither likely nor unlikely 28.00%7 Somewhat unlikely 0.00%0 Not likely at all 40.00%10 Total 25 Answer Percent Response Very likely 12.00%3 Somewhat likely 12.00%3 Neither likely nor unlikely 36.00%9 Somewhat unlikely 0.00%0 Not likely at all 40.00%10 Total 25 Answer Percent Response Very likely 12.00%3 Somewhat likely 4.00%1 Neither likely nor unlikely 32.00%8 Somewhat unlikely 12.00%3 Not likely at all 40.00%10 Total 25 Answer Percent Response Very likely 12.00%3 Somewhat likely 4.00%1 Neither likely nor unlikely 32.00%8 Somewhat unlikely 12.00%3 Not likely at all 40.00%10 Total 25 Answer Percent Response Very likely 12.00%3 Somewhat likely 4.00%1 Neither likely nor unlikely 44.00%11 Somewhat unlikely 0.00%0 Not likely at all 40.00%10 Total 25 Maximum 2 events per calendar week with incentives approximately 50% lower Maximum 3 events per calendar week with incentives approximately 25% lower With current program parameters and incentive levels Beyond the 2023 season, Idaho Power is exploring providing additional participation and incentive options for participants. How likely are you to enroll facilities in the Flex Peak program under the following hypothetical scenario options: Maximum 1 event per calendar week with incentives approximately 75% lower Maximum 1 event within a 7-day consecutive period with incentives approximately 80% lower Answer Percent Response Yes, I am the primary contact for the program.72.73%24 No, but I receive event notifications for the program.27.27%9 33 Percent Response 14.71%5 0.00%0 2.94%1 0.00%0 0.00%0 14.71%5 11.76%4 23.53%8 32.35%11 Total 34 Percent Response 27.27%9 54.55%18 9.09%3 6.06%2 3.03%1 Total 33 Percent Response 65.63%21 25.00%8 6.25%2 3.13%1 0.00%0 Total 32 Somewhat dissatisfied Very dissatisfied What industry best describes the facility enrolled in the Flex Peak program?(If you have multiple facilities enrolled in the program, check all that apply.) Grocery Office - Large Office - Small Retail School/University Warehouse Water/Wastewater Other (please specify) What is the main reason you chose to participate in the Flex Peak program? How satisfied were you with the following aspects in the Flex Peak program? Want to help reduce overall electrical usage on hot summer days Want to earn an incentive for providing demand reduction Seems like the right thing to do Need to meet a company sustainability initiative Other (Please Specify) Enrollment process Answer Very satisfied Somewhat satisfied Neither satisfied nor dissatisfied Answer 2022 Flex Peak Rewards Participant Survey Are you the primary contact for your company for the Flex Peak program? Total Answer Food manufacturing Percent Response Very satisfied 48.48%16 Somewhat satisfied 39.39%13 Neither satisfied nor dissatisfied 3.03%1 Somewhat dissatisfied 3.03%1 Very dissatisfied 6.06%2 Total 33 Percent Response Very satisfied 57.58%19 Somewhat satisfied 36.36%12 Neither satisfied nor dissatisfied 3.03%1 Somewhat dissatisfied 3.03%1 Very dissatisfied 0.00%0 Total 33 Percent Response Very satisfied 63.64%21 Somewhat satisfied 24.24%8 Neither satisfied nor dissatisfied 9.09%3 Somewhat dissatisfied 0.00%0 Very dissatisfied 3.03%1 Total 33 Percent Response Very satisfied 59.38%19 Somewhat satisfied 25.00%8 Neither satisfied nor dissatisfied 12.50%4 Somewhat dissatisfied 3.13%1 Very dissatisfied 0.00%0 Total 32 Percent Response Very satisfied 30.30%10 Somewhat satisfied 21.21%7 Neither satisfied nor dissatisfied 39.39%13 Somewhat dissatisfied 9.09%3 Very dissatisfied 0.00%0 Total 33 Timeliness of receiving the incentive payment/bill credits Event notification process Program support from Idaho Power How satisfied were you with the following components in the Flex Peak program's incentive payment structure? Incentive adjustment of $2/kW per hour of nomination not met during an event Answer Answer Post event performance data Answer Answer Answer Percent Response Very satisfied 30.30%10 Somewhat satisfied 33.33%11 Neither satisfied nor dissatisfied 36.36%12 Somewhat dissatisfied 0.00%0 Very dissatisfied 0.00%0 Total 33 Percent Response Very satisfied 30.30%10 Somewhat satisfied 27.27%9 Neither satisfied nor dissatisfied 36.36%12 Somewhat dissatisfied 6.06%2 Very dissatisfied 0.00%0 Total 33 Percent Response Very satisfied 27.27%9 Somewhat satisfied 42.42%14 Neither satisfied nor dissatisfied 21.21%7 Somewhat dissatisfied 9.09%3 Very dissatisfied 0.00%0 Total 33 Tuesday, July 26 Percent Response Very easy 27.27%9 Somewhat easy 15.15%5 Neither easy nor difficult 27.27%9 Somewhat difficult 21.21%7 Very difficult 9.09%3 Total 33 Thursday, July 28 Percent Response Very easy 27.27%9 Somewhat easy 18.18%6 Neither easy nor difficult 27.27%9 Somewhat difficult 18.18%6 Very difficult 9.09%3 Total 33 Answer Variable payment after the 4th event of $0.20/kWh Actual load reduction calculation during an event Weekly fixed incentive of $3.25/kW nominated How easy was it for your facility to meet its weekly nomination for each event this season? Answer Answer Answer Answer Monday, August 8 Percent Response Very easy 27.27%9 Somewhat easy 15.15%5 Neither easy nor difficult 21.21%7 Somewhat difficult 24.24%8 Very difficult 12.12%4 Total 33 Wednesday, August 17 Percent Response Very easy 24.24%8 Somewhat easy 18.18%6 Neither easy nor difficult 30.30%10 Somewhat difficult 21.21%7 Very difficult 6.06%2 Total 33 Wednesday, August 31 Percent Response Very easy 21.21%7 Somewhat easy 21.21%7 Neither easy nor difficult 30.30%10 Somewhat difficult 21.21%7 Very difficult 6.06%2 Total 33 Friday, September 2 Percent Response Very easy 21.21%7 Somewhat easy 18.18%6 Neither easy nor difficult 27.27%9 Somewhat difficult 21.21%7 Very difficult 12.12%4 Total 33 Tuesday, September 6 Percent Response Very easy 21.21%7 Somewhat easy 18.18%6 Neither easy nor difficult 33.33%11 Somewhat difficult 15.15%5 Very difficult 12.12%4 Total 33 Answer Answer Answer Answer Answer Percent Response Shut off lights 3.03%1 Adjust HVAC system 24.24%8 Shut down operations 39.39%13 Other (please specify)33.33%11 Total 33 Percent Response Individual(s) manually adjust specific system 51.52%17 Use an automated system to adjust specific systems 18.18%6 30.30%10 Total 33 Percent Response Very easy 18.18%6 Somewhat easy 42.42%14 Neither easy nor difficult 24.24%8 Somewhat difficult 12.12%4 Very difficult 3.03%1 Total 33 Percent Response Very satisfied 39.39%13 Somewhat satisfied 36.36%12 Neither satisfied nor dissatisfied 9.09%3 Somewhat dissatisfied 9.09%3 Very dissatisfied 6.06%2 Total 33 Percent Response Very likely 72.73%24 Somewhat likely 12.12%4 Neither likely nor unlikely 3.03%1 Somewhat unlikely 6.06%2 Very unlikely 6.06%2 Total 33 Percent Response Paper enrollment by mail 2.94%1 Enrollment by email 61.76%21 Online enrollment 35.29%12 Total 34 Answer What is your facility's primary action to reduce load during an event? Answer How does your facility reduce load during an event? How easy is it for you to understand how your load reduction is calculated during events? Overall, how satisfied are you with the Flex Peak program? Answer Use a mix of manual and automated processes to adjust specific systems Answer How likely are you to participate in the Flex Peak program in 2023? How would you prefer to receive the auto enrollment paperwork in the future?(Check all that apply) Answer Answer Percent Response Fixed incentive too small 11.11%1 Variable incentive too small 33.33%3 Wasn't beneficial this year 22.22%2 Events too late in the day 11.11%1 Too many events in the season 0.00%0 Events too close together 0.00%0 Negative impact to the business 0.00%0 Other (please specify)22.22%2 Total 9 Percent Response Very likely 15.15%5 Somewhat likely 12.12%4 Neither likely nor unlikely 24.24%8 Somewhat unlikely 27.27%9 Not likely at all 21.21%7 Total 33 Percent Response Very likely 15.15%5 Somewhat likely 12.12%4 Neither likely nor unlikely 24.24%8 Somewhat unlikely 27.27%9 Not likely at all 21.21%7 Total 33 Percent Response Very likely 6.06%2 Somewhat likely 15.15%5 Neither likely nor unlikely 36.36%12 Somewhat unlikely 15.15%5 Not likely at all 27.27%9 Total 33 Beyond the 2023 season, Idaho Power is exploring providing additional participation and incentive options for participants. How likely are you to enroll additional facilities in the Flex Peak program under the following hypothetical scenario options: Maximum 1 event per calendar week with incentives approximately 75% lower Maximum 1 event within a 7-day consecutive period with incentives approximately 80% lower Answer Answer Answer Answer Maximum 2 events per calendar week with incentives approximately 50% lower What about the program would prevent you from participating in 2023?(Check all that apply) Percent Response Very likely 12.12%4 Somewhat likely 21.21%7 Neither likely nor unlikely 21.21%7 Somewhat unlikely 24.24%8 Not likely at all 21.21%7 Total 33 Percent Response Very likely 39.39%13 Somewhat likely 15.15%5 Neither likely nor unlikely 24.24%8 Somewhat unlikely 9.09%3 Not likely at all 12.12%4 Total 33 Answer Answer With current program parameters and incentive levels Maximum 3 events per calendar week with incentives approximately 25% lower Metro Community Services 21 18.92% Eastern Idaho Community Action Partnership 3 2.70% El Ada Community Action Partnership 66 59.46% South Central Community Action Partnership 10 9.01% Southeastern Idaho Community Action Agency 11 9.91% Community Connection of Northeast Oregon 0 0.00% Community in Action 0 0.00% Total 111 Agency/Contractor flyer 19 16.67% Idaho Power employee 4 3.51% Idaho Power web site 16 14.04% Friend or relative 55 48.25% Letter in mail 4 3.51% Other (Please specify)16 14.04% Total 114 WICAP WICAP YCAP Headstart Family Advocate Heard about program HVAC Contractor local newspaper My wife friend or info through ID Power neighbor El Ada Emailed energy assistance, Idaho Power Family flyer with my electric bill found on line Agency/Contractor Name: How did you learn about the weatherization program? Other Option [Other (Please specify)] by phone EICAP Office El Ada Reduce utility bills 87 48.07% Improve comfort of home 36 19.89% Furnace concerns 32 17.68% Water heater concerns 5 2.76% Improve insulation 14 7.73% Other (please specify)7 3.87% Total 181 Completely 100 89.29% Somewhat 12 10.71% Not at all 0 0.00% Total 112 How air leaks affect energy usage 65 23.55% How insulation affects energy usage 38 13.77% How to program the new thermostat 42 15.22% How to reduce the amount of hot water used 27 9.78% How to use energy wisely 63 22.83% How to understand what uses the most energy in my home 40 14.49% Other (Please specify)1 0.36% Total 276 Other Option [Other (Please specify)] Everything they so great Which of the following did you learn about from the auditor or crew during the weatherization process? (Check all that apply) also receive help w/bill in winter heat pump and furnace my AC and heater broke my children comfort Really makes our home look better too! wanted to do my part to lower consumption and improve problems windows/draft and ice build up in winter What was your primary reason for participating in the weatherization program? Other Option [Other (please specify)] If you received any energy efficiency equipment upgrade as part of the weatherization, how well was the equipment's operation explained to you? Very likely 96 82.76% Somewhat likely 18 15.52% Not very likely 1 0.86% Not likely at all 1 0.86% Total 116 All of it 99 90.83% Some of it 9 8.26% None of it 1 0.92% Total 109 Very likely 77 70.64% Somewhat likely 30 27.52% Somewhat unlikely 1 0.92% Very unlikely 1 0.92% Total 109 Washing full loads of clothes 58 15.14% Washing full loads of dishes 44 11.49% Turning off lights when not in use 74 19.32% Unplugging electrical equipment when not in use 57 14.88% Turning the thermostat up in the summer 74 19.32% Turning the thermostat down in the winter 75 19.58% Other (please specify)1 0.26% Total 383 Significantly 107 92.24% Somewhat 6 5.17% Very little 2 1.72% Not at all 1 0.86% Total 116 Other Option [Other (please specify)] How much do you think the weatherization you received will affect the comfort of your home? We have no dishwasher, no washer, no dryer Based on the information you received from the agency/contractor about energy use, how likely are you to change your habits to save energy? How much of the information about energy use have you shared with other members of your household? If you shared the energy use information with other members of your household, how likely do you think household members will change habits to save energy? What habits are you and other members of your household most likely to change to save energy? (check all that apply) Rate the Agency/Contractor based on your interactions with them. Courteousness Excellent 114 98.28% Good 2 1.72% Fair 0 0.00% Poor 0 0.00% Total 116 Professionalism Excellent 114 98.28% Good 2 1.72% Fair 0 0.00% Poor 0 0.00% Total 116 Explanation of work to be performed on your home Excellent 110 97.35% Good 3 2.65% Fair 0 0.00% Poor 0 0.00% Total 113 Overall experience with Agency/Contractor Excellent 112 98.25% Good 2 1.75% Fair 0 0.00% Poor 0 0.00% Total 114 Yes 89 78.07% No 25 21.93% Total 114 Very satisfied 112 98.25% Somewhat satisfied 1 0.88% Somewhat dissatisfied 0 0.00% Very dissatisfied 1 0.88% Total 114 Were you aware of Idaho Power's role in the weatherization of your home? Overall how satisfied are you with the weatherization program you participated in? Improved 110 94.83% Stayed the same 6 5.17% Decreased 0 0.00% Total 116 0 25 21.55% 1 22 18.97% 2 29 25.00% 3 22 18.97% 4 6 5.17% 5 7 6.03% 6 or more 5 4.31% Total 116 Less than 1 year 3 2.59% 1-10 years 26 22.41% 11-25 years 42 36.21% 26 years or more 45 38.79% Total 116 Under 25 2 1.71% 25-34 7 5.98% 35-44 21 17.95% 45-54 28 23.93% 55-64 22 18.80% 65-74 22 18.80% 75 or older 15 12.82% Total 117 Less than High School 15 12.93% High School graduate or GED 58 50.00% Some College or Technical School 23 19.83% Associate Degree 8 6.90% College Degree (including any graduate school or graduate degrees)12 10.34% Total 116 How many people, beside yourself, live in your home year-round? How long have you been an Idaho Power customer? Please select the category below that best describes your age: Select the response below that best describes the highest level of education you have attained: How has your opinion of Idaho Power changed as a result of its role in the weatherization program? Thank you for helping the community, and us! Thank you Thank you Thank you to all involved in the process and Happy New Year! Thank you. Your help is very much appreciated. no comments but received signature no responses but received signature no responses marked but signature received survey signed 7/1/22 Thamk you! We are very happy and much more comfortable now. Thank you I think t his program is very benificial to the people that it helps. very impressed with service I want to thank you for all of this It's a wonderful program for families and the staff is fantastic. the guys worked above and beyond. Loved Wayne and Dave help, courteousness, good education, explanations, efficiency. Very knowledgeable. A pleasure to have in my home. I liked everyone! May consider more advertising (in my area) no answers marked but signature received I am very thankful with everything, I have more than I ask. god bless you I appreciate everything that Idaho Power has done for us. We don't dserve it and we are very blessed to get this service. I have used and appreciated your help on keeping my home comfortable I really appreciate all that was accomplished in my home to helf me conserve on electricity. The Metro team were very respectful and I feel did a great job. I really appreciate this I think it was Great estoy muy contenta con todo lo que me ayuduron para octerer esta nueva calecfacion y todo lo que me pusieron muchas gracias Everyone is wonderful at El Ada and Elite Systems. Thank you so much. good comments to IDAOH Power How very nice it is to help low income seniors living on Social Security that would never be able to afford new windows or central heat and air. Thank you so much I am thankful for the services performed by SCCAP I am very thankful and apreciative for everything Idaho Power did. Thank you so much! Angie hizo muy buen trabajo y estoy my agradecida con ella por toda su ayuda. Tambuen Doug y loas demas se portaron muy amables connigo. completely satisfied Customer declined to complete. customer signed but didn't complete survey-cpaoli customer signed but left survey blank-CPaoli Did a great job. thanks kindly Please share any other comments you may have regarding Idaho Power's weatherization programs. Thank you. a pleasure to have the team come in and help us. very satisfied Thanks for 'Everything' The team that came to work at my place were very polite and explained to me, in a way I could understand always let me know they were on there way. I always felt safe in there presence. Thank This is a great program! Thank you so much! This is a great team of people from the office staff to the contractors! Everyone was friendly and informitive. The qualify of work was very good and everything seemed to go smoothly. we are very impressed with everyone involved but the stand out was the window insallation, incredible attendion to detail!! Very happy with the work and very appreciated and greateful for this program. Thank You very nice people Thankful & will recommend to others Thankful for the help Metro Contractor Services 0 0.00% Home Energy Management 19 95.00% Savings Around Power 1 5.00% Power Savers 0 0.00% Energy Solutions 0 0.00% Total 20 Agency/Contractor flyer 0 0.00% Idaho Power employee 0 0.00% Idaho Power web site 1 5.26% Friend or relative 4 21.05% Letter in mail 2 10.53% Other (Please specify)12 63.16% Total 19 Reduce utility bills 12 63.16% Improve comfort of home 4 21.05% Furnace concerns 1 5.26% Water heater concerns 0 0.00% Improve insulation 1 5.26% Other (please specify)1 5.26% Total 19 bill stuff Bill Stuffer Heard about program My wife friend or info through ID Power to help conserve everyday use How did you learn about the weatherization program? Agency/Contractor Name: bill stuffer bill stuffer bill stuffer bill stuffer Other Option [Other (please specify)] What was your primary reason for participating in the weatherization program? Other Option [Other (Please specify)] bill stuffer bill stuffer bill stuffer bill stuffer Completely 8 42.11% Somewhat 1 5.26% Not at all 10 52.63% Total 19 How air leaks affect energy usage 18 20.22% How insulation affects energy usage 18 20.22% How to program the new thermostat 5 5.62% How to reduce the amount of hot water used 17 19.10% How to use energy wisely 17 19.10% How to understand what uses the most energy in my home 13 14.61% Other (Please specify)1 1.12% Total 89 Very likely 15 78.95% Somewhat likely 4 21.05% Not very likely 0 0.00% Not likely at all 0 0.00% Total 19 All of it 8 88.89% Some of it 1 11.11% None of it 0 0.00% Total 9 Very likely 9 90.00% Somewhat likely 0 0.00% Somewhat unlikely 1 10.00% Very unlikely 0 0.00% Total 10 all of the above Other Option [Other (Please specify)] Which of the following did you learn about from the auditor or crew during the weatherization If you received any energy efficiency equipment upgrade as part of the weatherization, how well was the equipment's operation explained to you? If you shared the energy use information with other members of your household, how likely do you think household members will change habits to save energy? How much of the information about energy use have you shared with other members of your Based on the information you received from the agency/contractor about energy use, how likely are you to change your habits to save energy? Washing full loads of clothes 2 9.09% Washing full loads of dishes 0 0.00% Turning off lights when not in use 1 4.55% Unplugging electrical equipment when not in use 9 40.91% Turning the thermostat up in the summer 1 4.55% Turning the thermostat down in the winter 1 4.55% Other (please specify)8 36.36% Total 22 Significantly 16 84.21% Somewhat 3 15.79% Very little 0 0.00% Not at all 0 0.00% Total 19 Excellent 19 100.00% Good 0 0.00% Fair 0 0.00% Poor 0 0.00% Total 19 Excellent 19 100.00% Good 0 0.00% Fair 0 0.00% Poor 0 0.00% Total 19 Does these already client already does these Already Does these How much do you think the weatherization you received will affect the comfort of your home? Other Option [Other (please specify)] What habits are you and other members of your household most likely to change to save energy? (check all that apply) already does these already practice these already does these already does these Professionalism Courteousness Rate the Agency/Contractor based on your interactions with them. Excellent 19 100.00% Good 0 0.00% Fair 0 0.00% Poor 0 0.00% Total 19 Excellent 19 100.00% Good 0 0.00% Fair 0 0.00% Poor 0 0.00% Total 19 Yes 18 100.00% No 0 0.00% Total 18 Very satisfied 18 100.00% Somewhat satisfied 0 0.00% Somewhat dissatisfied 0 0.00% Very dissatisfied 0 0.00% Total 18 Improved 15 78.95% Stayed the same 4 21.05% Decreased 0 0.00% Total 19 0 9 47.37% 1 7 36.84% 2 1 5.26% 3 2 10.53% 4 0 0.00% 5 0 0.00% 6 or more 0 0.00% Total 19 Were you aware of Idaho Power's role in the weatherization of your home? Overall experience with Agency/Contractor Explanation of work to be performed on your home How many people, beside yourself, live in your home year-round? How has your opinion of Idaho Power changed as a result of its role in the weatherization Overall how satisfied are you with the weatherization program you participated in? Less than 1 year 0 0.00% 1-10 years 4 22.22% 11-25 years 3 16.67% 26 years or more 11 61.11% Total 18 Under 25 0 0.00% 25-34 2 10.53% 35-44 1 5.26% 45-54 0 0.00% 55-64 4 21.05% 65-74 5 26.32% 75 or older 7 36.84% Total 19 Less than High School 1 5.26% High School graduate or GED 7 36.84% Some College or Technical School 7 36.84% Associate Degree 3 15.79% College Degree (including any graduate school or graduate degrees)1 5.26% Total 19 Select the response below that best describes the highest level of education you have attained: Please select the category below that best describes your age: How long have you been an Idaho Power customer? Answer Percent Responses Owner 97.66%167 Employee 2.34%4 Total 171 Answer Percent Responses Yes 28.07%48 No 59.65%102 Not sure 12.28%21 Total 171 Answer Percent Responses Fixed incentive too small 9.56%28 Variable incentive too small 7.51%22 Too much risk for crops 13.65%40 Too much trouble to coordinate (system/labor)12.97%38 Need more advance notification for events 7.17%21 Don't understand the benefits of the program 11.60%34 Too many events per week 2.73%8 Wasn't beneficial to me 9.56%28 Events too late in the day 6.83%20 Other (please specify)18.43%54 Total 293 Answer Percent Responses Yes 46.20%79 No 38.01%65 Not sure 15.79%27 Total 171 Answer Percent Responses Very easy 32.91%26 Somewhat easy 32.91%26 Neither easy nor difficult 21.52%17 Somewhat difficult 10.13%8 Very difficult 2.53%2 Total 79 How easy was it to understand the information in the Peak Rewards enrollment packet? 2022 Peak Rewards Non Participant Survey Are you the owner or an employee of the farm, ranch, or business? Have you participated in Idaho Power's Peak Rewards program in the past? Which best describes your reason for not participating in the Peak Rewards program?(Check all that apply) Do you recall receiving a Peak Rewards enrollment packet in the mail? Answer Percent Responses Paper enrollment by mail 45.03%77 Online enrollment 29.82%51 Both 25.15%43 Total 171 Answer Percent Responses Very likely 8.77%15 Somewhat likely 16.37%28 Neither likely nor unlikely 21.05%36 Somewhat unlikely 9.94%17 Not likely at all 43.86%75 Total 171 Answer Percent Responses Very likely 7.02%12 Somewhat likely 16.96%29 Neither likely nor unlikely 22.81%39 Somewhat unlikely 5.26%9 Not likely at all 47.95%82 Total 171 Answer Percent Responses Very likely 4.68%8 Somewhat likely 14.04%24 Neither likely nor unlikely 25.73%44 Somewhat unlikely 8.19%14 Not likely at all 47.37%81 Total 171 Answer Percent Responses Very likely 3.51%6 Somewhat likely 11.70%20 Neither likely nor unlikely 26.32%45 Somewhat unlikely 7.02%12 Not likely at all 51.46%88 Total 171 Maximum 2 events per calendar week with incentives approximately 50% lower Maximum 3 events per calendar week with incentives approximately 25% lower How would you prefer to receive the future enrollment paperwork? Beyond the 2023 season, Idaho Power is exploring providing additional participation and incentive options for participants. How likely are you to enroll pump locations in the Peak Rewards program under the following hypothetical scenario options: Maximum 1 event per calendar week with incentives approximately 75% lower Maximum 1 event within a 7-day consecutive period with incentives approximately 80% lower Answer Percent Responses Very likely 9.94%17 Somewhat likely 16.96%29 Neither likely nor unlikely 28.65%49 Somewhat unlikely 9.94%17 Not likely at all 34.50%59 Total 171 Answer Percent Responses Yes 8.19%14 No 91.81%157 Not sure 0.00%0 Total 171 With current program parameters and incentive levels Did you attend any of Idaho Power's irrigation workshops in the last 12 months? Answer Percent Responses Owner 86.02%80 Employee 13.98%13 Total 93 Answer Percent Responses Idaho Power mailed enrollment packet 47.29%61 Idaho Power workshop 18.60%24 Idaho Power employee 10.85%14 Idaho Power Peak Rewards advertisement 17.83%23 Other (please specify)5.43%7 Total 129 Answer Percent Responses Time of event hours 19.77%17 Possible number of events 11.63%10 Crop Type 17.44%15 Irrigation system type 41.86%36 Other (please specify)9.30%8 Total 86 Answer Percent Responses Yes 47.31%44 No 34.41%32 Not sure 18.28%17 Total 93 Answer Percent Responses Increased variable incentive 68.00%34 Later potential event time of 11 pm did not negatively impact me 22.00%11 Other (please specify)10.00%5 Total 50 Are you the owner or an employee of the participating farm, ranch, or business? If you have service locations not enrolled in the Peak Rewards program, what is preventing you from enrolling all of your irrigation service locations in the program? (Check all that apply) 2022 Peak Rewards Participant Survey How did you learn about the Peak Rewards program?(Check all that apply) The Extended Interruption Option allows for events between 3 pm and 11 pm and offers an increased variable incentive of $0.25 per event kWh. Did you select the Extended Interruption Option during enrollment for one or more of your pumps? What made you choose to participate in the Extended Interruption Option? Answer Percent Responses Very satisfied 33.33%31 Somewhat satisfied 41.94%39 Neither satisfied nor dissatisfied 6.45%6 Somewhat dissatisfied 11.83%11 Very dissatisfied 6.45%6 Total 93 Answer Percent Responses Very likely 60.22%56 Somewhat likely 24.73%23 Neither likely nor unlikely 4.30%4 Somewhat unlikely 3.23%3 Very unlikely 7.53%7 Total 93 Answer Percent Responses Paper enrollment by mail 45.57%36 Online enrollment 16.46%13 Both 37.97%30 Total 79 Answer Percent Responses I plan to increase my level of participation 7.59%6 I plan to not change my level of participation 82.28%65 I plan to decrease my level of participation 10.13%8 Total 79 Answer Percent Responses Fixed incentive too small 18.60%8 Variable incentive too small 16.28%7 Too much risk for crops 16.28%7 Too much trouble to coordinate (system/labor)16.28%7 Wasn't beneficial this year 11.63%5 Events too late in the day 13.95%6 Other (please specify)6.98%3 Total 43 Overall, how satisfied are you with the Peak Rewards Program? How likely are you to participate in the Peak Rewards Program in 2023 at any of your service locations? How would you prefer to receive the future enrollment paperwork? Do you plan to change your participation level in the program in 2023? What about the program would prevent you from participating in 2023?(Check all that apply) Answer Percent Responses Very likely 5.38%5 Somewhat likely 16.13%15 Neither likely nor unlikely 20.43%19 Somewhat unlikely 9.68%9 Not likely at all 48.39%45 Total 93 Answer Percent Responses Very likely 6.45%6 Somewhat likely 12.90%12 Neither likely nor unlikely 17.20%16 Somewhat unlikely 15.05%14 Not likely at all 48.39%45 Total 93 Answer Percent Responses Very likely 6.45%6 Somewhat likely 10.75%10 Neither likely nor unlikely 19.35%18 Somewhat unlikely 20.43%19 Not likely at all 43.01%40 Total 93 Answer Percent Responses Very likely 2.15%2 Somewhat likely 17.20%16 Neither likely nor unlikely 20.43%19 Somewhat unlikely 13.98%13 Not likely at all 46.24%43 Total 93 Answer Percent Responses Very likely 37.63%35 Somewhat likely 25.81%24 Neither likely nor unlikely 15.05%14 Somewhat unlikely 4.30%4 Not likely at all 17.20%16 Total 93 Maximum 2 events per calendar week with incentives approximately 50% lower Maximum 3 events per calendar week with incentives approximately 25% lower With current program parameters and incentive level Beyond the 2023 season, Idaho Power is exploring providing additional participation and incentive options for participants. How likely are you to enroll additional pump locations in the Peak Rewards program under the following hypothetical scenario options: Maximum 1 event within a 7-day consecutive period with incentives approximately 80% lower Maximum 1 event per calendar week with Incentives approximately 75% lower Answer Percent Responses Yes 16.13%15 No 79.57%74 Not sure 4.30%4 Total 93 Did you attend any of Idaho Power's irrigation workshops in the last 12 months? Answer Percent Responses Idaho Power employee 14.47%11 Contractor 63.16%48 Equipment supplier 6.58%5 Other business owner 7.89%6 Other (please specify)7.89%6 Total 76 Answer Percent Responses Very satisfied 82.89%63 Somewhat satisfied 14.47%11 Neither satisfied nor dissatisfied 1.32%1 Somewhat dissatisfied 1.32%1 Very dissatisfied 0.00%0 Total 76 Answer Percent Responses Very satisfied 89.47%68 Somewhat satisfied 9.21%7 Neither satisfied nor dissatisfied 1.32%1 Somewhat dissatisfied 0.00%0 Very dissatisfied 0.00%0 Total 76 Answer Percent Responses Very satisfied 89.47%68 Somewhat satisfied 7.89%6 Neither satisfied nor dissatisfied 2.63%2 Somewhat dissatisfied 0.00%0 Very dissatisfied 0.00%0 Total 76 Answer Percent Responses Yes 6.58%5 No 93.42%71 Total 76 How satisfied are you with the contractor that you hired to install the equipment? 2022 Retrofits Survey Results Would you like Idaho Power to follow up with you regarding this survey or the Retrofits program? How did you learn about the Retrofits program? How satisfied are you with the equipment that was installed? Overall, how satisfied are you with the Idaho Power Retrofits incentive program? Answer Percent Responses Very Satisfied 89.36%42 Somewhat Satisfied 8.51%4 Somewhat Dissatisfied 2.13%1 Very Dissatisfied 0.00%0 Total 47 Answer Percent Responses Very satisfied 93.62%44 Somewhat satisfied 6.38%3 Neither satisfied nor dissatisfied 0.00%0 Somewhat dissatisfied 0.00%0 Total 47 Answer Percent Responses Very satisfied 89.36%42 Somewhat satisfied 6.38%3 Neither satisfied nor dissatisfied 4.26%2 Somewhat dissatisfied 0.00%0 Total 47 Answer Percent Responses Yes 10.64%5 No 89.36%42 Total 47 2022 SBDI Non Respondent Follow Up Survey How satisfied are you with the customer service provided by the company installing the equipment? Would you like Idaho Power to follow up with you regarding this survey or the Small Business Direct Install program? Overall, how satisfied are you with the program? How satisfied are you with the equipment that was installed? 2022 SBDI Program Customer Satisfaction Survey Responses Q7 Response Breakout Response Number of Responses Program was free / Cost is right 58 Lighting Upgrade/Better Lighting 52 Efficiency & Savings 44 No response 18 Misc. responses 10 Participated due to letter/Outreach/WOM 8 Wanting to upgrade to LED and program helped 2 Building owner or landlord decided to participate 2 Q8 Response Breakout Response Number of Responses No improvement suggestions 55 Provide more clarity about scheduling process and improve communication on process 8 Program sounds too good to be true, very skeptical with letter and contractor who stopped by. Suggest different marketing. 2 Bring threshold of amount higher so more businesses can take part in program. 1 Look harder to install occupancy sensors in larger areas. 1 Q9 Response Breakout Response Number of Responses No/Nothing 50 Solar panels 2 Computer backup surge protector systems 1 Heat control for showers 1 Door sealing strips 1 Motion sensors 1 Dimmer switches 1 Covers for outsides of windows to prevent heat from radiation 1 Matching existing LED lights to the new install 1 Answer Percent Responses Email from Idaho Power 44.74%170 Friend or relative 29.47%112 Neighbor 5.26%20 Utility employee 2.63%10 Other (please specify)17.89%68 Total 380 Answer Percent Responses Tree was free 14.09%51 Home too warm in the summer 16.02%58 Reduce energy bill 14.92%54 Improve landscape/property value 17.68%64 Wanted a tree 19.89%72 Help the environment 14.92%54 Other (please specify)11.76%9 Total 362 Answer Percent Responses Lack of knowledge 16.57%60 Cost 47.51%172 Time 11.60%42 Other (please specify)24.31%88 Total 362 Answer Percent Responses Garden section of a do-it-yourself/home improvement store 35.08%127 Nursery/garden store 61.88%224 Other (please specify)3.04%11 Total 362 Answer Percent Responses 10 minutes or less 59.49%210 11-20 minutes 32.29%114 21-30 minutes 6.52%23 31 minutes or more 1.70%6 Total 353 2022 Shade Tree Survey Results Where would you typically purchase a new tree?(Mark one) How long did you spend on the online enrollment tool? (Mark one) How did you hear about Idaho Power's Shade Tree Project(Check all that apply) What was the primary reason you participated in the program?(Mark one) What kept you from planting a tree prior to the Shade Tree Project?(Mark one) Answer Percent Responses Very easy 73.31%261 Somewhat easy 24.44%87 Somewhat difficult 2.25%8 Very difficult 0.00%0 Total 356 Answer Percent Responses Received by mail 50.70%108 Picked up at Boise event 10.80%23 Picked up at Nampa event 20.19%43 Picked up at Meridian event 18.31%39 Don't know 0.00%0 Total 213 Answer Percent Responses Received by mail 46.31%69 Picked up at Boise event 6.71%10 Picked up at Twin Falls event 44.30%66 Don't know 2.68%4 Total 149 Answer Percent Responses One 14.64%53 Two 85.36%309 Total 362 Ordered One Tree When did you plant your shade tree? Answer Percent Responses 22.64%12 50.94%27 9.43%5 9.43%5 7.55%4 Same day as the tree arrival/pick up pickup 1-3 days after the tree arrival/pick up pickup 4-7 days after the tree arrival/pick up Pickup more than 1 week after the tree arrival/pick up Did not plant the trees Total Answer Percent Responses North 10.20%5 South 10.20%5 Northeast 8.16%4 Southwest 18.37%9 East 12.24%6 West 28.57%14 Southeast 4.08%2 Northwest 8.16%4 Total 49 Answer Percent Responses 20 feet or less 46.94%23 21-40 feet 42.86%21 41-60 feet 8.16%4 More than 60 feet 2.04%1 Total 49 Answer Percent Responses One 4.21%13 Two 84.79%262 Did not plant the trees 11.00%34 Total 309 When did you plant your shade tree? Answer Percent Responses Same day as the tree arrival/pickup 7.69%1 1-3 days after the tree arrival/pickup 46.15%6 4-7 days after the tree arrival/pickup 7.69%1 More than 1 week after the tree arrival/pickup 38.46%5 Total 13 On which side of your home did you plant your shade tree? How far from the home did you plant your shade tree? Ordered Two Trees How many shade trees did you plant? Ordered Two, Planted One On which side of your home did you plant your shade tree? Answer Percent Responses North 7.69%1 South 23.08%3 Northeast 0.00%0 Southwest 0.00%0 East 23.08%3 West 38.46%5 Southeast 0.00%0 Northwest 7.69%1 Total 13 Answer Percent Responses 20 feet or less 46.15%6 21-40 feet 53.85%7 41-60 feet 0.00%0 More than 60 feet 0.00%0 Total 13 Answer Percent Responses Same day as the tree arrival/pickup 16.41%43 1-3 days after the tree arrival/pickup 52.29%137 4-7 days after the tree arrival/pickup 17.18%45 More than 1 week after the tree arrival/pickup 14.12%37 Total 262 Answer Percent Responses Same day as the tree arrival/pickup 15.65%41 1-3 days after the tree arrival/pickup 49.62%130 4-7 days after the tree arrival/pickup 19.08%50 More than 1 week after the tree arrival/pickup 15.65%41 Total 262 How far from the home did you plant your shade tree? When did you plant your shade tree? Tree One Tree Two Ordered Two, Planted Two Answer Percent Responses North 10.69%28 South 12.60%33 Northeast 3.82%10 Southwest 15.27%40 East 11.45%30 West 35.88%94 Southeast 5.73%15 Northwest 4.58%12 Total 262 Answer Percent Responses North 6.11%16 South 12.21%32 Northeast 4.58%12 Southwest 19.08%50 East 11.83%31 West 33.21%87 Southeast 9.16%24 Northwest 3.82%10 Total 262 Tree One Answer Percent Responses 20 feet or less 28.24%74 21-40 feet 55.34%145 41-60 feet 12.60%33 More than 60 feet 3.82%10 Total 262 Answer Percent Responses 20 feet or less 22.52%59 21-40 feet 54.96%144 41-60 feet 16.41%43 More than 60 feet 6.11%16 Total 262 How far from the home did you plant your shade tree? Tree One Tree Two On which side of your home did you plant your shade tree? Tree Two Answer Percent Responses Changed my mind 1.96%1 Did not like the tree 1.96%1 Did not have time 5.88%3 Other (please specify)90.20%46 Total 51 Answer Percent Responses Very satisfied 78.73%285 Somewhat satisfied 17.40%63 Somewhat dissatisfied 3.04%11 Very dissatisfied 0.83%3 Total 362 Answer Percent Responses Planting depth 48.04%172 Circling roots 14.53%52 Staking 8.66%31 Watering 22.91%82 Other (please specify)5.87%21 Total 358 I am satisfied with Shade Tree Project delivery method Answer Percent Responses Strongly agree 58.88%63 Somewhat agree 24.30%26 Somewhat disagree 10.28%11 Strongly disagree 6.54%7 Total 107 Answer Percent Responses Strongly agree 85.71%90 Somewhat agree 13.33 14 Somewhat disagree 0.95%1 Strongly disagree 0.00%0 Total 105 Why did you not plant your tree?(Check all that apply) How satisfied are you with the information you received on the planting and care of your shade tree? What information did you find most valuable? How much do you agree with the following statements: I am satisfied with the Shade Tree Project pick up event Answer Percent Responses Strongly agree 64.43%230 Somewhat agree 24.37%87 Somewhat disagree 6.72%24 Strongly disagree 4.48%16 Total 357 Answer Percent Responses Strongly agree 79.57%257 Somewhat agree 19.20%62 Somewhat disagree 1.24%4 Strongly disagree 0.00%0 Total 323 Answer Percent Responses Strongly agree 90.83%327 Somewhat agree 7.50%27 Somewhat disagree 0.56%2 Strongly disagree 1.11%4 Total 360 I am satisfied with my overall experience Answer Percent Responses Very likely 80.56%290 Somewhat likely 14.72%53 Neither likely nor unlikely 2.78%10 Somewhat unlikely 1.94%7 Total 360 May we use your name and comments? Answer Percent Responses Yes 54.97%199 No 45.03%163 Total 362 Answer Percent Responses Yes 64.82%234 No 35.18%127 Total 361 May we follow up with you? It was easy to plant my shade tree(s) I am satisfied with the tree(s) I received from the Shade Tree Project I would recommend the program to a friend or relative Answer Percent Responses Before 1950 8.86%32 1950-1959 4.43%16 1960-1969 3.60%13 1970-1979 11.91%43 1980-1989 5.54%20 1990-1999 6.93%25 2000-2009 15.24%55 2010-2019 15.24%55 2020-present 26.87%97 Don't know 1.39%5 Total 361 Answer Percent Responses Electricity 43.21%156 Natural gas 42.94%155 Propane 5.54%20 Fuel oil 0.28%1 Wood 6.37%23 Other (please specify)1.66%6 Total 361 Answer Percent Responses None 3.64%14 Central air conditioner 70.91%273 Heat pump 16.88%65 Individual room or window air conditioner 6.75%26 Evaporative/swamp cooler 1.04%4 Other (please specify)0.78%3 Total 385 Answer Percent Responses Under 18 0.28%1 18-24 0.84%3 25-34 17.55%63 35-44 27.02%97 45-60 31.20%112 Over 60 23.12%83 Total 359 Which of the following best describes your age? What one fuel is most often used to heat this residence? What type of air conditioning system is used at this residence? (Check all that apply) When was this residence originally built?(Select when the building was originally constructed . Not when it was remodeled, added to, or converted.) Supplement 2: Evaluation Demand-Side Management 2022 Annual Report Page 249 EVALUATIONS Report Title Sector Analysis Performed By Study Manager Study/Evaluation Type Idaho Power Company Commercial and Industrial Energy Efficiency Program—Retrofits 2021 Program Year Impact and Process Evaluation Results Commercial, Industrial Tetra Tech Idaho Power Impact and Process Evaluation Idaho Power 2021 Home Energy Report Program Impact Evaluation Residential ADM Idaho Power Impact Evaluation Impact & Process Evaluation of Idaho Power Company PY2021 Commercial Energy-Saving Kits Program Commercial ADM Idaho Power Impact and Process Evaluation Idaho Power Company Commercial and Industrial Energy Efficiency Program—New Construction 2021 Program Year Impact and Process Evaluation Results Commercial, Industrial Tetra Tech Idaho Power Impact and Process Evaluation Supplement 2: Evaluation Page 250 Demand-Side Management 2022 Annual Report Idaho Power Company Idaho Power Company Commercial and Industrial Energy Efficiency Program – Retrofits 2021 Program Year Impact and Process Evaluation Results November 30, 2022 ii Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 6410 Enterprise Lane, Suite 300 | Madison, WI 53719 Tel 608-316-3700 | Fax 608-200-3278 tetratech.com © 2022 Tetra Tech, Inc. All Rights Reserved. iii Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 TABLE OF CONTENTS 1.0 EXECUTIVE SUMMARY ................................................................................................................. 1 1.1 Program Description .................................................................................................................. 1 1.2 Methodology .............................................................................................................................. 1 1.3 Findings and Recommendations ................................................................................................ 2 1.3.1 Impact Recommendations ................................................................................................. 2 1.3.2 Process Recommendations ............................................................................................... 3 2.0 INTRODUCTION ............................................................................................................................. 4 2.1 Program Overview ..................................................................................................................... 4 2.2 Evaluation Activities ................................................................................................................... 5 2.2.1 Evaluation Goals ............................................................................................................... 5 3.0 IMPACT EVALUATION ................................................................................................................... 7 3.1 Methodology .............................................................................................................................. 7 3.2 Impact Review Results ............................................................................................................... 9 3.2.1 Lighting............................................................................................................................ 10 3.2.2 Non-Lighting .................................................................................................................... 14 3.3 Review of PY2018 Impact Recommendations .......................................................................... 15 4.0 PROCESS EVALUATION ............................................................................................................. 17 4.1 Methodology ............................................................................................................................ 17 4.2 Process Review Results........................................................................................................... 17 4.2.1 Materials and Outreach Review ....................................................................................... 18 4.2.2 Interview Contractors ....................................................................................................... 20 LIST OF TABLES Table 1. PY2021 Program Realization Rates ......................................................................................... 2 Table 2. PY2021 Retrofits Summary by Project Measure Type .............................................................. 4 Table 3. PY2021 Retrofits Offering Evaluation Activities ........................................................................ 5 Table 4. PY2021 Retrofits Sampling Summary ...................................................................................... 8 Table 5: PY2021 Realization Rates of Sampled Projects ....................................................................... 9 Table 6. PY2021 Retrofits Lighting Impact Results Summary .............................................................. 11 Table 7: PY2021 Non-Lighting Impact Results Summary ..................................................................... 14 iv Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 Table 8. PY2018 CIEE Retrofits Program Recommendations .............................................................. 15 LIST OF FIGURES Figure 1. Impact Evaluation Activities .................................................................................................... 1 Figure 2. Process Evaluation Activities .................................................................................................. 2 Figure 3. Process for Verifying Program Savings ................................................................................... 7 Figure 4. Process Evaluation Activities ................................................................................................ 17 v Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 ACKNOWLEDGEMENTS We would like to acknowledge the many individuals who contributed to the 2021 impact and process evaluation of the Retrofits offering of the Idaho Power Commercial and Industrial Efficiency program. This evaluation effort would not have been possible without their help and support. We would like to specifically thank Shelley Martin, Chad Severson, and Kathy Yi of Idaho Power, who provided invaluable insight into the program and operations. These individuals participated in ongoing evaluation deliverable reviews and discussions and graciously responded to follow-up questions and data and documentation requests. Tetra Tech received valuable assistance from Idaho Power Energy Advisors with scheduling verification visits. The Tetra Tech Evaluation Team was made up of the following individuals: Kimberly Bakalars, Mark Bergum, Graham Thorbrogger, Nathan Kwan, Andrew Spista, and Laura Meyer. 1 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 1.0 EXECUTIVE SUMMARY Tetra Tech is pleased to provide Idaho Power Company (Idaho Power) with a report for the 2022 impact and process evaluation of the 2021 Retrofits offering of the Idaho Power Commercial and Industrial Energy Efficiency Program (CIEE Program). The Idaho Power CIEE Program provides a comprehensive menu of incentives and services to facilitate the implementation of cost-effective energy-efficiency improvements for commercial and industrial customers. Incentives cover retrofits, new construction and major renovation projects, and custom incentives for cost-effective projects not covered on the menu of incentives. This report section consists of (1) an introduction describing the program, (2) methodology, and (3) key findings and recommendations. The detailed impact results can be found in Section 3.0, with process results detailed in Section 4.0. 1.1 PROGRAM DESCRIPTION The Retrofits (Retrofits) offering of the CIEE program provides incentives for prescriptive energy-saving retrofit measures to existing equipment or facilities. This part of the program encourages customers in Idaho and Oregon to implement energy efficiency upgrades by offering incentives on a defined list of measures. Eligible measures cover various energy-saving opportunities in lighting, HVAC, building shell, food service equipment, and other commercial measures. Customers can also apply for non-standard lighting incentives. Customers complete the preapproval application if they are interested in receiving Retrofits incentives (if the estimated project costs are over $1,500). Application forms are specific to lighting or non-lighting measures, and customers must use the form that matches their measure type. Both forms are completed if the project includes both lighting and non-lighting equipment. Idaho Power reviews each application and works with the customer and vendors to gather sufficient information. Licensed electrical contractors are required for most lighting project installations. Once the eligible equipment is installed, the customer completes the application process by submitting the payment application with all the necessary documentation and emailing it to Idaho Power. If the customer wants the incentive payment to go to a third party, information for the third party is required. 1.2 METHODOLOGY To address the evaluation objectives, which included verifying energy impacts attributable to the 2021 program, providing estimates of realization rates, and suggesting enhancements to the savings analysis and reporting, the evaluation team conducted the impact evaluation activities shown in Figure 1. Figure 1. Impact Evaluation Activities Tetra Tech also conducted a process evaluation for the Retrofits offering. Figure 2 highlights the activities undertaken to address the process research objectives. Review data and conduct sampling Complete desk reviews Conduct site verifications Verify kilowatt-hour savings 2 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 Figure 2. Process Evaluation Activities 1.3 FINDINGS AND RECOMMENDATIONS The impact evaluation for the Retrofits offering found a successfully-run program that balances the use of prescriptive assumptions and values with the data collection from the project site. The program stays current with baseline requirements and market conditions for measures and documents their calculation methods and assumptions in template spreadsheets. During the on-site visits, the evaluation found minor adjustments to building hours of operations and lighting control systems. Still, overall, findings from the impact evaluation show the program savings calculations are accurate and well-documented. The overall realization rate for the program is 96.4 percent, as shown in Table 1. Table 1. PY2021 Program Realization Rates Measure type Number of projects MWh claimed MWh evaluated Program realization rate Lighting and controls 751 19,755 18,985 96.1% Non-lighting 36 1,426 1,426 100.0% Total 787 21,181 20,411 96.4% 1.3.1 Impact Recommendations The following impact recommendations are provided for Idaho Power's consideration: Develop the exterior lighting controls savings factors. The lighting control savings claimed for projects are identical for interior and exterior controls. However, the exterior lighting controls tend to result in substantially less savings because the controls are likely to allow partial power instead of completely disconnecting the fixture like interior fixtures. A separate lighting control savings factor will account for this adjustment. Document lighting control savings for transparency to the applicant. The lighting control savings are incorporated into the lighting tool, although the savings are hidden in the same line as the lighting equipment retrofit. The Retrofits offering can support the participant in making more informed decisions by (1) publishing the table detailing the energy savings percentage per lighting control type and (2) documenting the lighting control savings separately from the lighting equipment savings. These steps will start a conversation with participant staff about access, operation, and expectations of control systems. Consider incorporating interactive effects into the Retrofits lighting tool. Idaho Power's current lighting tool does not incorporate interactive effects of the lighting wattage reduction on the HVAC load; this is different from the stacking effect when both lighting and HVAC are installed. A reduced lighting load reduces the internal heat gain to the building, which reduces the air conditioning and cooling load while increasing the heating load. Incorporating interactive effects into the lighting tool can more accurately report energy savings based on actual site conditions; however, the lighting application will have to collect information regarding the heating fuel and the type of air conditioning. Program staff interviews Materials and outreach review Contractor interviews 3 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 Consider adjusting the anti-sweat heater measure to differentiate between medium- and low-temperature refrigeration. The latest Technical Reference Manual (TRM) provides a single energy savings value for an anti-sweat heater for glass case doors on refrigerators (medium temperature) and freezers (low temperature). There is an assumption about the split between medium temperature and low temperature. Creating a measure for each will attribute savings more accurately to each location that installs anti-sweat heaters. 1.3.2 Process Recommendations The Retrofits offering of the CIEE program is operating well. Contractors feel supported and informed of program requirements and changes. Idaho Power staff have acted on previous recommendations to consolidate CIEE program information, and a couple of the current recommendations are an extension of that strategy. The following process recommendations are provided for Idaho Power's consideration: Continue to increase in-person program overview training where possible. Idaho Power has resumed scheduling face-to-face meetings with contractors after suspending them during the COVID-19 pandemic. Our conversations with contractors confirm a real appetite for resuming those meetings and trainings. Although they understand why meetings were suspended, several contractors mentioned interest in getting back to more face-to-face meetings for the interaction they provide with Idaho Power staff and other contractors. Consider developing a consolidated contractor list across CIEE programs with substantial overlap. The New Construction Program Specialist conducts numerous outreach activities with architects and engineers. However, firms we spoke with were often unclear on which CIEE program offering they were utilizing (New Construction, Retrofits, Custom) because it was usually more than one. A consolidated list of active contractors, architects, and engineering firms may help coordinate messaging to market actors, giving them more clarity as they work with customers. Maintaining a combined outreach list will also provide documentation in the event of staff changes and can assist with further managing outreach and engagement. Tracking could include flags for the type of contractor, date of last event attendance, and record notes on known relationships where firms are working together, such as compressed air firms working with engineering firms, lighting distributors working with installers, etc. Consider a leave-behind brochure for contractors with all CIEE programs. There is substantial overlap in experience across programs among firms we interviewed. Idaho Power already approaches contractor and design firm conversations with a CIEE overview and leaves appropriate program-specific information for them, depending on the contractor's specialty. Also leaving behind an overview of all the CIEE programs may help the contractors and design firms better understand the different incentive options Idaho Power provides, and how they can direct customers to the most appropriate offering depending on their situation. 4 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 2.0 INTRODUCTION 2.1 PROGRAM OVERVIEW The Retrofits offering of the Commercial and Industrial Energy Efficiency program (CIEE) provides incentives for prescriptive energy-saving retrofit measures to existing equipment or facilities. This part of the program encourages customers in Idaho and Oregon to implement energy efficiency upgrades by offering incentives on a defined list of measures. Eligible measures cover a variety of energy-saving opportunities in lighting, HVAC, building shell, food service equipment, and other commercial measures. Customers can also apply for non-standard lighting incentives. Customers interested in receiving Retrofits offering incentives complete the preapproval application if the estimated project costs are over $1,500. Application forms are specific to lighting or non-lighting measures, and customers must use the form that matches their measure type. Both forms are completed if the project includes both lighting and non-lighting equipment. Idaho Power reviews each application and works with the customer and vendors to gather sufficient information. Licensed electrical contractors are required for most lighting project installations. Once the eligible equipment is installed, the customer completes the application process by submitting the payment application with all required documentation and emailing it to Idaho Power. If the customer wants the incentive payment to go to a third-party, information for the third party is required. In 2021, 787 projects were completed through the program, with a total savings of 21,181 MWh. Over 90 percent of the projects and savings are from the lighting and controls measure category. Although the non-lighting portion of the program contains various measures, it is not used by local contractors as much as the lighting component. Table 2. PY2021 Retrofits Summary by Project Measure Type Measure Number of projects MWh saved Lighting and controls 751 19,755 Non-lighting 36 1,426 Total 787 21,181 Complete pre-approval application •Download lighting tool or non-lighting application and worksheets; complete applicable sections •Gather specification sheets •Email for Idaho Power review Install equipment •Must use licensed contractor for certain measures •Inspections may occur before or after project installation Complete payment application •Adjust pre-approval information if needed •Download if not preapproved and fill out •Include specification sheets •Email for Idaho Power review 5 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 2.2 EVALUATION ACTIVITIES The evaluation activities conducted for the Retrofits offering are summarized in Table 3. This section also discusses research issues and the sampling strategy for desk reviews and on-site visits. Table 3. PY2021 Retrofits Offering Evaluation Activities Activity Sample size Outcome Interviews with program delivery staff 1 Understood program design and delivery and obtained program staff perspective on program successes and challenges. We also confirmed researchable issues. Review of program delivery and marketing materials N/A Reviewed materials such as marketing brochures, program manuals, outreach plans, and the program website for messaging and communication benefits. Tracking system review N/A Reviewed the tracking system to determine if all necessary inputs are tracked and if reporting tools contain sufficient information for program review. Desk reviews 30 Reviewed project documentation and calculations to assess the accuracy of savings claimed for each project. This included review of the energy savings calculations for conformance to the TRM for the version year identified. Verification on-site visits 13 Completed visits to a sample of sites to verify the installation of incentivized measures and check assumptions used in savings calculations. The locations were matched to projects that have had a completed desk review. Contractor interviews 11 Collected feedback from contractors working with the program, which included satisfaction and suggested improvements. 2.2.1 Evaluation Goals The impact and process evaluation goals below were addressed through the various evaluation activities: Impact Evaluation • Review the tracking database to determine and verify the energy (kilowatt-hour) impacts attributable to the 2021 program. • Complete file reviews and verify engineering calculations with 90/10 (relative error of no more than 10 percent with 90 percent confidence) confidence and precision. • Provide credible and reliable program energy and non-energy impact estimates and ex-post realization rates attributed to the program for the 2021 program year. • Report findings and observations and provide recommendations that enhance the effectiveness of future ex-ante savings analysis and the accurate and transparent reporting of program savings. • Verify installation and operating conditions of equipment. Process Evaluation 6 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 • Evaluate program design to ensure the use of industry best practices. • Evaluate program implementation, including quality control, operational practice, and outreach. • Review program forms, manuals, and marketing materials, and provide recommendations for improvements as needed. • Evaluate program administration, including program oversight, staffing, management, training, documentation, and reporting. • Understand customer and contractor barriers to participation in the program and provide recommendations to increase participation. • Investigate how to best integrate the Custom Projects, New Construction, and Retrofits offerings. • Identify contractor motivations for installing energy-efficient equipment and whether the program or incentive has an effect. 7 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 3.0 IMPACT EVALUATION The following sections provide a detailed review of the impact evaluation methodology, evaluation results, and recommendations from the evaluation activities. 3.1 METHODOLOGY The impact methodology consisted of the four primary evaluation activities shown in Figure 3. Each activity is explained in more detail below. Figure 3. Process for Verifying Program Savings Review Data and Conduct Sampling The tracking system and documentation were provided to the evaluation team for review; the tracking data included a combination of information from Idaho Power and participants. The Project Applications for the Retrofits offering collected information from the program applicant, including the following: • account information, including business name and account or meter number, installation address, and contact information; • a project description (non-lighting); • estimated project costs and savings (only on lighting projects); • project timeline information (dates); and • vendor or installer information. • Payee information Idaho Power logged this information and stored it in the program tracking database, CLRIS. In addition to the information above, the CLRIS database includes: • a project ID; • customer rate class; • participant region and Idaho Power energy advisor; • project type (lighting or non-lighting); • project measure; • application status, including interim dates of Idaho Power actions, such as application submission, payment to the participant, and final inspection; • incentive details; and Review data and conduct sampling Complete desk reviews Conduct site verifications Verify kilowatt-hour savings 8 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 • gross kilowatt and kilowatt-hour savings and incentives per measure. Additional database tables are kept, which connect the project ID and information above with the measure-level information listed below. Some information is carried over, which is not represented in the list. • premise and landlord type; • project application unique name; • project building type; • non-energy benefit (NEB) value; • units of measure for equipment quantity; • existing equipment notes, size, and quantity with the estimated energy consumption of the baseline; • proposed equipment notes, size, and quantity with the estimated energy consumption of the new energy-efficient equipment; and • measure-level savings claimed and incentive. Sampling was conducted at the project ID level using tracking data. The sample was stratified to ensure the random sample matched the evaluation goals to understand non-lighting and the lighting and controls sector. The sampling is summarized in Table 4. Table 4. PY2021 Retrofits Sampling Summary Sampling stratum Total projects (total quantity) Program kWh savings percentage Sample projects (total quantity) Sample kWh savings percentage Lighting and controls 751 93.3% 21 12.4% Non-lighting 36 6.7% 9 1.4% Total 787 100.0% 30 13.9% The objective of the impact evaluation was to meet the precision requirement of 90/10 (relative error of no more than 10 percent with 90 percent confidence). The sampling used a probability proportionate to size (PPS) approach, with the kilowatt-hour savings for each project representing its size. In this approach, every participant has a known probability of selection, but the probability is no longer equal. Instead, a participant with twice the kilowatt-hour savings as another participant has twice the likelihood of being selected. The resulting evaluated savings and realization rates should be unbiased and represent the population more efficiently (i.e., with a smaller sampling error). In addition to the PPS sampling, Tetra Tech applied several other criteria to ensure the distribution of the projects matched the evaluation goals. The following criteria were included in the sampling: • In the non-lighting stratum, a minimum of four projects from PY2021. • In the lighting stratum, a minimum of two projects per Idaho Power region. The list of sampled projects was delivered to Idaho Power. The individual project files were securely delivered to the evaluation team by an internet-based file-sharing site that required log-in access. The files delivered included: 9 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 • applications, • lighting tool calculator (administrative version), • measure worksheet scans for non-lighting projects, • labor-and-materials invoices, • equipment specification sheets and certifications, • post-installation inspections (when available), • photos, and • a screenshot of the tracking system project closeout. Complete Desk Reviews Tetra Tech staff conducted desk reviews of the sampled project files. This engineering and documentation review was conducted to describe the project, confirm tracking data, identify key assumptions, and determine critical questions before the site verification phase. Conduct Site Verification Tetra Tech engineers conducted site verification visits from August 3‒5 and August 8‒12. Idaho Power staff were invited to attend the site visits. While on-site, Tetra Tech engineers conducted a walkthrough of the building and interviewed site representatives to verify the installation and operation of energy-efficient equipment. Parameters verified included lighting and HVAC quantities, equipment specifications, the functionality of lighting controls, and lighting operating hours. Verifying key operating assumptions and equipment performance confirms the installation and attention to the operating parameters. Finally, the evaluation inspectors asked key questions to confirm assumptions and determine satisfaction with the program process. Verify Kilowatt-Hour Savings The final step of the impact evaluation combined desk review and site verification information to provide quality assurance for each reviewed project, describe any revisions to project assumptions and actual conditions, and update calculations to finalize evaluated savings. The data gathered from the site verifications was reconciled with the information from the initial desk reviews. Desk reviews and site verifications were completed for thirteen participants, and the remaining seventeen had only a desk review completed. 3.2 IMPACT REVIEW RESULTS Overall, the evaluation found that the Retrofits offering had an impact realization rate of 96.4 percent with a relative precision of 3.0 percent at the 90 percent confidence interval. The measure category realization rates are shown in Table 5. Table 5: PY2021 Realization Rates of Sampled Projects Measure Ex-ante kWh Ex-post kWh Realization rate Lighting and controls 2,620,404 2,516,780 96.1% Non-lighting 332,874 332,874 100.0% 10 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 The overall program realization rate of 96 percent is slightly lower than the 99 percent realization rate from the previous evaluation for PY2018. The realization rate decreased because the on-site verifications identified adjustments to exterior lighting controls and hours of operation of participating facilities. The variability between the DesignLights Consortium (DLC) certification wattage listed and the lighting equipment specification sheets also contributed to a slight adjustment in the realization rate. In addition to evaluating the savings claimed, available information—including calculation protocols and the program's quality assurance—was reviewed. The Idaho Power Retrofits documentation is clear, and the application workbook is sufficient in providing clear direction and communication of project parameters from contractors to Idaho Power. Once a project is finalized, Idaho Power creates an administrative copy of the savings worksheets to incorporate adjustments to the application information and the energy savings adjustments required by the program rules. Idaho Power's lighting tool was used to calculate savings for Retrofits lighting projects reviewed in 2021. This lighting tool allows for simplified savings calculation verifications, with dropdowns and lookup tables for many baseline lighting types, ease of defining custom facility hours of operation, and the application of control factors to incorporate installed lighting controls. The evaluation did identify that the lighting tool does not account for the interactive effects between the lower lighting wattage and the load of the HVAC system. Documentation for lighting projects was consistent and adequate in verifying claimed energy savings, with only a few instances of missing post-inspection forms or invoices that were not itemized with lighting model numbers. The post-install inspection reports were organized and detailed to determine verified installation equipment and operations. On-site visits of Retrofits lighting projects verified assumptions and equipment claimed. However, the operation of the lighting controls for exterior lighting (e.g., networked controls) did not match the expected operation to obtain the percentage of savings claimed by the measure. There was also minimal exterior lighting control operational knowledge from the site representatives; the evaluation team reached out to lighting contractors or suppliers to confirm the operation. In addition, the site visits identified hours of operation differences from the custom hours entered in the lighting tool for two other locations. On-site visits of Retrofits non-lighting projects verified equipment model numbers and quantities. Documentation identifying savings calculation methodology (i.e., deemed savings values or TRM version) was not provided for the sampled projects; however, the evaluation team was able to verify the saving claimed through individual project confirmation with program staff. Increasing the documentation to verify the program rules or TRM version along with the savings calculation methodology is an opportunity for improvement. The evaluation team found that the confirmation of proposed or installed equipment was consistent. However, Idaho Power does not use third-party verification of efficiency or lighting fixture wattages, such as DLC or Air Conditioning, Heating, and Refrigeration Insititute (AHRI). Because the evaluation team uses DLC and AHRI to determine equipment energy consumption, this resulted in some lighting savings adjustments to Retrofits projects. 3.2.1 Lighting Lighting projects account for approximately 93 percent of the 2021 Retrofits offering savings. The sample included 21 projects with lighting only or lighting and controls components, accounting for about 91 percent of the sampled kilowatt-hours. Table 6 shows realization rates for each project, with the total 11 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 realization rate for claimed lighting savings at 96 percent. Table 6. PY2021 Retrofits Lighting Impact Results Summary Project ID Claimed kWh Evaluated kWh Realization rate 200344 171,395 170,953 99.7% 200369 14,710 12,940 88.0% 200437 267,698 268,273 100.2% 200483 191,064 191,064 100.0% 200493 98,366 98,366 100.0% 200528 138,197 136,060 98.5% 200545 132,838 127,503 96.0% 200591 24,826 25,545 102.9% 200598 110,263 102,964 93.4% 200604 14,436 13,939 96.6% 200612 10,411 10,061 96.6% 200619 215,472 212,683 98.7% 200639 485,914 422,254 86.9% 200657 314,376 300,033 95.4% 200681 35,621 35,693 100.2% 200774 2,268 2,262 99.8% 210065 19,553 19,553 100.0% 210089 13,856 9,873 71.3% 210173 63,582 56,166 88.3% 210379 291,664 297,152 101.9% 210516 3,895 3,443 88.4% Overall 2,620,404 2,516,780 96.1% The lighting energy efficiency was determined using the lighting tool, which develops comprehensive lighting retrofit savings for C&I projects. The document acts as an application collecting project description, location, installation contractor, and electrical supplier information. The form also collects detailed information about the lighting operating schedules, installed equipment specifications, and quantity. Based on the evaluation findings, there are opportunities to increase the accuracy of the claimed savings calculated, although alternatives discussed with the program staff found that the improvement was minimal compared to the effort to adjust. The lighting equipment specification section identifies the Qualified Product List (QPL) for each lighting fixture installed, allowing for exceptions. The lighting input wattage collected is entered on the product type sheet; however, using the QPL-listed wattages is not specified. The evaluation adjusted wattages to meet the QPL listing on about half of the sampled projects. The evaluation adjusts wattages to the DLC QPL listed wattages because the third-party independent testing of individual fixture energy 12 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 consumption provides consistency across lighting fixtures in the marketplace. Since the lighting input wattage increased and decreased through this adjustment, the overall impact of these adjustments is minimal at the program level. The lighting energy saving is straightforward once the information in the application is collected. However, two components would increase the accuracy of the lighting energy savings calculation. First, the lighting retrofit has interactive effects on HVAC systems because the heat generated by the decreased wattages installed changes the building heat load, typically ranging between a three and five percent adjustment on the energy savings. Second, the addition of the lighting controls energy consumption reduction would help participants understand the overall impact of the lighting controls, make better-informed decisions about the value of the controls, and understand the scale of the attributed savings. Separating lighting control savings from the lighting equipment savings will provide marketplace support to detail the potential value of the controls. The lighting control savings percentages were reviewed and reasonable for the installed interior lighting control systems. The exterior lighting control systems overestimated energy savings when using similar control structures. The primary reason for the variation between indoor and outdoor lighting control savings is that the exterior lighting is programmed to a partial level when the sensors consider there is no need for lighting, while the interior system will completely shut off under the same conditions. Incorporating the exterior lighting control typical operation can reduce the control savings percentage by up to 30 percent for the advanced control systems. The evaluation incorporated this adjustment to the exterior lighting Networked Area Controls and Networked LLLC Controls energy savings percentage to reduce the savings from 50 percent to 35 percent of estimated consumption. The descriptions below detail the evaluation findings for each lighting savings adjustment. Project ID 200344: A business replaced exterior metal halide lighting with LED lighting and networked controls. The evaluation team adjusted lighting wattages to their DLC- and ENERGY STAR®-certified values, slightly decreasing energy savings. The realization rate is nearly 100 percent. Project ID 200369: A business replaced exterior metal halide and compact fluorescent lighting with LED lighting. The evaluation team conducted an on-site visit and found lighting controls were malfunctioning; savings for these controls were removed from the evaluation calculations, reducing energy savings. The realization rate is 88 percent. Project ID 200437: A warehouse replaced interior fluorescent lighting, exterior metal halide lighting, and exterior halogen lighting with LED lighting. The evaluation team calculated identical energy savings for this project. The realization rate is 100 percent. Project ID 200483: A manufacturer replaced metal halide high bay lighting with LED lighting. The evaluation team calculated identical energy savings for this project. The realization rate is 100 percent. Project ID 200493: An educational facility replaced exterior metal halide lighting with LED lighting. The evaluation team conducted an on-site visit and confirmed all fixture types and quantities. The realization rate is 100 percent. Project ID 200528: A business replaced exterior pulse-start HID lighting with LED lighting and dusk-to-dawn photocell controls in their parking lot. The evaluation team conducted an on-site visit and confirmed all fixture types and quantities. The fixture wattage for one model was adjusted to the DLC-certified value, slightly decreasing savings. The realization rate is 99 percent. Project ID 200545: A warehouse and retailer replaced interior incandescent lighting, interior fluorescent lighting, and exterior metal halide lighting with LED lighting and networked controls. The 13 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 evaluation team conducted an on-site visit, confirming hours of operation and controls. Also, 340 four-foot LED fixtures were found instead of the documented count of 169 eight-foot fixtures. One fixture model was not found, and other fixture wattages were updated to their DLC-certified values, reducing savings. The realization rate is 96 percent. Project ID 200591: A business replaced interior linear fluorescent lighting with LED lighting and occupancy sensors in their parts room. The evaluation team conducted an on-site visit, confirming hours of operation, lighting quantities, and controls. Fixture wattages were updated to their DLC-certified values, increasing savings. The realization rate is 103 percent. Project ID 200598: A business replaced exterior metal halide and compact fluorescent lighting with LED lighting and occupancy sensor controls. The evaluation team conducted an on-site visit, confirming lighting quantities. Controls could not be verified as operational, and their savings were removed from the evaluation calculations. Fixture wattages were updated to their DLC-certified values. Both adjustments decreased energy savings. The realization rate is 93 percent. Project ID 200604: A customer replaced exterior metal halide lighting with LED lighting. The evaluation team conducted an on-site visit, confirming fixture type, but found one less fixture than claimed, decreasing savings. Fixture wattages were updated to their DLC-certified values, also decreasing savings. The realization rate is 97 percent. Project ID 200612: A customer replaced exterior metal halide lighting with LED lighting. The evaluation team conducted an on-site visit, confirming fixture type, but foundone less fixture than claimed, decreasing savings. Fixture wattages were updated to their DLC-certified values, also decreasing savings. The realization rate is 97 percent. Project ID 200619: A business replaced exterior metal halide lighting with LED lighting. The evaluation team updated fixture wattages to their DLC-certified values, decreasing savings. The realization rate is 99 percent. Project ID 200639: A manufacturer replaced interior linear fluorescent lighting, exterior metal halide lighting, and exterior high-pressure sodium lighting with LED lighting. The evaluation team conducted an on-site visit, finding lighting to average 14.4 hours per day instead of the claimed 16 hours per day; this decreased savings. The realization rate is 87 percent. Project ID 200657: A business replaced exterior HID metal halide lighting with LED lighting and networked controls. The evaluation team conducted an on-site visit, verifying lighting quantities and hours of operation. The control strategy was changed from networked controls (LLLC) to multiple control strategies, as they were in effect for approximately half of the night. Fixture wattages were updated to their DLC-certified values. Both adjustments decreased energy savings. The realization rate is 95 percent. Project ID 200681: A customer replaced interior linear fluorescent lighting, interior metal halide lighting, and exterior metal halide lighting with LED lighting. The evaluation team adjusted fixture wattages to their DLC-certified values, slightly increasing savings. The realization rate is 100 percent. Project ID 200774: A retailer replaced exterior metal halide lighting with LED lighting. The evaluation team adjusted fixture wattages to their DLC-certified values, slightly decreasing savings. The realization rate is 100 percent. Project ID 210065: A warehouse replaced interior linear fluorescent lighting with LED lighting via self-installation. The evaluation team conducted an on-site visit, verifying operating hours and lighting quantities. The realization rate is 100 percent. 14 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 Project ID 210089: A facility replaced interior linear fluorescent lighting with LED lighting. The evaluation team conducted an on-site visit, verifying operating hours and sensor types. The onsite documented 106 light fixtures were installed while the claimed calculation showed 104 fixtures. The baseline fixtures removed was 97 fixtures, so this was not adjusted. Fixture wattages were updated to their DLC-certified values. These two adjustments decreased energy savings. The realization rate is 71 percent. Project ID 210173: An academic building replaced interior linear fluorescent lighting with LED lighting. The evaluation team conducted an on-site visit. Actual annual operating hours were decreased from 5,892 to 5,053 because the schedule provided was used for approximately 45 weeks of the year. The on-stite visit identified two fewer fixtures installed than were listed in the documentation. Fixture wattages were also updated to their DLC-certified values. These three findings decreased energy savings. The realization rate is 88 percent. Project ID 210379: A large industrial facility replaced interior linear fluorescent lighting with LED lighting. The evaluation team updated fixture wattages to their DLC-certified values, slightly increasing energy savings. The realization rate is 102 percent. Project ID 210516: An agricultural building replaced interior incandescent lighting, exterior metal halide lighting, and external high-pressure sodium lighting with LED lighting. The evaluation team conducted an on-site visit. No pole-mounted fixtures were found, but all other fixture types and quantities were confirmed. Fixture wattages were also updated to their DLC-certified values, increasing energy savings. The realization rate is 101 percent. 3.2.2 Non-Lighting Non-lighting projects account for seven percent of the 2021 Retrofits offering savings. The sample included nine projects which accounted for less than 12 percent of the sampled kilowatt-hours and less than 2 percent of the overall program savings. Six projects were related to HVAC and HVAC control retrofits, two projects were related to food service equipment, and one project was related to compressed air equipment. Table 7 shows that the realization rate for the savings claimed is 100 percent for the sampled projects. Table 7: PY2021 Non-Lighting Impact Results Summary Project ID Claimed kWh Evaluated kWh Realization rate 200515 8,556 8,556 100.0% 200582 146,097 146,097 100.0% 210228 36,544 36,544 100.0% 210230 4,108 4,108 100.0% 210279 26,625 26,625 100.0% 210422 58,957 58,957 100.0% 210444 47,450 47,450 100.0% 210499 2,432 2,432 100.0% 210631 2,106 2,106 100.0% Overall 332,874 332,874 100.0% 15 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 Overall, the evaluation team found that the documentation provided was adequate to justify savings claims; however, the provision of calculation sheets and equipment nameplate photos would support more robust savings verifications. Project ID 200515: This retailer installed a new 5-ton air conditioning unit and HVAC controls (demand-controlled ventilation and economizer). The evaluation team identified identical deemed energy savings for this project. The realization rate is 100 percent. Project ID 200582: This religious building installed HVAC controls (optimum start and optimum stop, DCV, and supply air temperature reset) on a retrofit packaged rooftop system. The evaluation team identified identical deemed energy savings for this project. The realization rate is 100 percent. Project ID 210228: The customer installed HVAC controls (optimum start and optimum stop) on a retrofit packaged rooftop system. The evaluation team identified identical deemed energy savings for this project. The realization rate is 100 percent. Project ID 210230: The business installed one standard electric oven and nine auto-close doors on reach-in coolers and freezers. The evaluation team identified identical deemed energy savings for the auto-close doors and convection oven. The oven was determined to be ENERGY STAR and therefore was eligible for the RTF energy savings. The realization rate is 100 percent. Project ID 210279: This customer installed a variable frequency drive (VFD) on an HVAC fan. The evaluation team identified identical deemed energy savings for this project. The realization rate is 100 percent. Project ID 210422: The business installed anti-sweat heater controls on coolers and freezers. The evaluation team identified identical deemed energy savings for this project. The realization rate is 100 percent. Project ID 210444: This manufacturing facility installed a VFD on a 50 hp air compressor. The evaluation team identified identical deemed energy savings for this project. The realization rate is 100 percent. Project ID 210499: This retailer replaced four air conditioning units. The evaluation team identified identical deemed energy savings for this project. The realization rate is 100 percent. Project ID 210631: The business replaced three water-cooled heat pumps. The evaluation team identified identical deemed energy savings for this project, resulting in a realization rate of 100 percent. 3.3 REVIEW OF PY2018 IMPACT RECOMMENDATIONS As part of the impact evaluation, Tetra Tech reviewed Idaho Power's progress against the recommendations made during the last impact evaluation of the 2018 program. The table below highlights Idaho Power's actions to address each of the previous impact recommendations. Table 8. PY2018 CIEE Retrofits Program Recommendations Category Key findings and recommendations PY2021 implementation Status Post-installation verification Consider requiring pictures of the motor nameplate for the motor connected to VFDs. Idaho Power is not collecting nameplate photos as part of the application. Alternate documentation was instituted because the nameplate photo was Complete 16 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 Category Key findings and recommendations PY2021 implementation Status deemed potentially unsafe for staff or participants. Alternate verification is in place that satisfies the evaluation team. 17 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 4.0 PROCESS EVALUATION The following sections provide a detailed review of the process evaluation methodology, evaluation results, and recommendations from the evaluation activities. 4.1 METHODOLOGY The process methodology consisted of the three primary evaluation activities shown in Figure 4. Each activity is explained below. Figure 4. Process Evaluation Activities Program Staff Interviews Idaho Power staff responsible for the program delivery provided Tetra Tech staff with an overview of the program design, objectives, staffing, outreach, procedures, tracking, and achievements. Idaho Power program staff also responded to evaluation questions and provided requested materials. Materials and Outreach Review Tetra Tech read the Idaho Power Commercial and Industrial Energy Efficiency Policies and Procedures Manual dated January 2021. The program logic model developed in 2018 was also reviewed for the entire CIEE program at the time, including Retrofits, New Construction, and Custom Projects offerings. Tetra Tech explored the Idaho Power website for energy efficiency information for businesses and any linked documentation, including applications and instructions. Idaho Power staff also provided an overarching CIEE slide deck and general CIEE brochure to facilitate discussions with customers and contractors regarding all the CIEE offerings from Idaho Power. A program-specific Retrofits brochure was also reviewed, which details the incentives and requirements for the Retrofits offering. Contractor Interviews Customers work with installation contractors and equipment distributors for the energy-efficiency equipment that is eligible for Retrofits offering incentives. The Program Specialist provided a list of contractors associated with projects in 2021. Tetra Tech sampled 33 companies, and the Program Specialist provided contact information. All customers with email addresses were emailed and followed up with via telephone to complete interviews with 11 contractors that could provide feedback on the Retrofits offering incentives. 4.2 PROCESS REVIEW RESULTS Idaho Power follows program management best practices with a program manual and logic model developed for the CIEE suite of programs. Communication between Idaho Power and contractors is working well, and contractors find the application process straightforward and easy to complete for their customers. Program staff interviews Materials and outreach review Contractor interviews 18 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 4.2.1 Materials and Outreach Review Policies and Procedures Manual Tetra Tech reviewed the 2020 and 2021 versions of the Idaho Power Commercial and Industrial Energy Efficiency Policies and Procedures Manual. The 2020 version was updated through November 2019, and the 2021 version was updated in January 2021. Edits to the manual included slight customer eligibility changes and equipment adjustments. The program manual includes a good overview of all CIEE offerings from Idaho Power. In addition, it offers sufficient detail for each major offering (Custom, Retrofits, and New Construction), such as preapproval and payment application processes and inspection requirements. Other commercial offerings, including Energy Assessments, Energy-Saving Kits, Flex Peak, Green Rewind, and Technical Training, are briefly described for the reader. The Idaho Power contact information and revision history sections also benefit both internal utility and external partner and customer users. Other resources listed include approximately 25 organizations like ASHRAE, ENERGY STAR®, and Integrated Design Labs. The primary program manual sections include the following: 1. Program Overview - including eligibility requirements 2. Program Offerings - Retrofits, New Construction, Custom Projects, Additional Offerings 3. Steps to Participate - Lighting retrofits, Non-lighting retrofits, New Construction 4. Custom Projects - steps to participate 5. Energy Efficient Assessments 6. Inspections, Measurement, and Verification 7. False Information 8. Preapproval 9. Satisfaction of Customers 10. Program Staff Contact Information 11. Commercial & Industrial Energy Efficiency Program Terms and Conditions 12. Other Resources 13. Review and Revision History Logic Model Our review of the CIEE logic model, developed in 2018 in response to a previous evaluation recommendation, shows that the Retrofits offering closely follows the program design and delivery steps laid out in the logic model. The major steps— (1) project identification and outreach, (2) preapproval applications, (3) Idaho Power project review, (4) project implementation, and (5) payment application—are all in line with the current program delivery as outlined in the program policies and procedures manual. In addition, the program's short- and long-term outcomes are being realized, and measures such as certain lighting and compressed air equipment have been identified for a transition from Custom incentives to prescriptive under the Retrofits offering. 19 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 Outreach The Retrofits offering continues to provide marketing in conjunction with all CIEE offerings. Methods such as bill inserts, newsletters, airport advertising, radio, and social media messages communicate the benefits businesses can realize through Idaho Power's energy efficiency programs. In addition, specific activities in 2021 for Retrofits included: • seven workshops via webinar for program trade allies and large commercial customers to inform them of program updates; • a virtual program presentation to the local International Brotherhood of Electrical Workers (IBEW); • a lighting controls training class via webinar for continuing education units (CEU) to trade allies and large customers; • lighting postcards (sent to 1,400 businesses in October); • a revision to the Retrofits brochure, splitting it into two: one specific to Idaho customers and the other for Oregon customers; • a redesign of the Retrofits website, so customers first choose which state the project will be completed in, so they are directed to the incentives specific to that state; • a pop-up ad placed on My Account in September (resulting in 2,859 views and 160 click-throughs from business customers); • the development of a point-of-purchase display placed at the checkout counter at 60 lighting suppliers to promote lighting incentives (the displays received very positive comments from suppliers); • emails promoting the lighting incentives were followed up with by Idaho Power Customer Solutions Advisor phone calls to customers who received the email; and • promoting Retrofits lighting incentives to electrical contractors, electrical distributors, and energy service companies by a contracted Lighting Trade Ally Outreach Specialist. The Idaho Power website was explored for energy efficiency information for businesses and any linked documentation, including applications and instructions. The selection of state and then Retrofits offering information was easy to follow. Since most of the initial marketing and outreach are done as an overarching CIEE program, Idaho Power staff provided (1) the overarching CIEE slide deck and (2) the general CIEE brochure that staff use to facilitate discussions with customers and contractors regarding all CIEE offerings from Idaho Power. A program-specific Retrofits brochure was also reviewed, which details the incentives and requirements for the Retrofits offering of the CIEE program. All slides and brochures are visually appealing and provide good information on what is offered through the CIEE program. The Retrofits brochure provides the specific information needed for customers or contractors interested in applying for incentives through the program. 20 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 4.2.2 Interview Contractors A mix of 33 contractor firms was contacted from a list provided by Idaho Power; interviews were completed with 11 of them in August and September 2022. Three were compressed-air businesses working with engineering firms, three were electrical or lighting distributors, three were installers, and two were design firms. All primarily work with C&I customers, with little residential work. The interviewed contractors have all worked with Idaho Power programs for several years. At least five also have experience with the Custom or New Construction offerings of the CIEE program. Most contractors work with other firms to deliver program services to customers, such as engineering firms and equipment distributors working with installation contractors. Communication Contractors we spoke with unanimously felt they were getting the information they needed about the Retrofits offering. Email notifications have been working well for everyone. In addition, at least five contractors mentioned having the Program Specialist's phone number and contacting her directly for assistance. Four contractors thought the pre-pandemic in-person meetings were beneficial for the information distributed at the meeting and the interaction with Idaho Power and other contractor staff. All this outreach explains the high level of contractor awareness regarding the Retrofits offering. Although customers are not as aware of the offering, according to the contractors we spoke with, the contractors and suppliers introduce the Retrofits offering incentives to their customers during the project design phase, sales process, or service calls. There was substantial overlap in contractor use of CIEE programs, such as Custom and New Construction options, along with Retrofits. When Idaho Power talks with contractors, they use an overview brochure that summarizes the CIEE programs, then discussions focus on specific contractor services. While contractors feel knowledgeable about the incentives available, they understand that customers are not as knowledgeable. A couple of contractors suggested that a comprehensive summary of the programs for them to share with customers may be helpful as they discuss incentive options. Once customers were aware of the Retrofits offering incentives, contractors felt that it assisted in motivating customers to purchase energy-efficient equipment. Applications Most suppliers and larger companies complete the application for the customer or smaller contractors they work with as a customer benefit. Only one contractor thought the $1,500 preapproval threshold was limiting and suggested a shift to $2,500. In contrast, a couple of contractors completed preapprovals for all of their projects, even if they were less than $1,500, to ensure the project would qualify the customer for an incentive. Three of the contractors interviewed think that Idaho Power's application process is one of the easiest compared with other programs they have experienced. Most have never had an application declined, but a couple reported checks on savings compared with usage, resulting in adjustments to reported savings and incentives paid.. Idaho Power confirmed that this is a quality control check they instituted to ensure project savings on applications are less than the consumption of the business. "Their lighting tool is exceptional, they’ve made it very streamlined. I’ve worked with others and IPC’s is probably the best." Most customers receive their incentive checks directly. However, contractors are flexible and will 21 Idaho Power C&I Retrofits – 2021 Evaluation Results. November 30, 2022 discount an invoice by the incentive amount if the customer prefers that option. Six of the contractors say at least 90 percent of the incentives go to customers; for two others, it was about 50 percent. Satisfaction Satisfaction with the Retrofits offering of the CIEE program is high. When asked how they would rate the Retrofits offering on a five-point scale, where 1 is not at all satisfied and 5 is very satisfied, eight of the contractors rated the program a 4 or 5. Nobody we spoke with was dissatisfied. The contractors we spoke with had few suggestions for improving the Retrofits offering. Most feel that the program successfully serves large C&I customers with high operating hours (closer to 24/7). However, a couple of the contractors were concerned that it is more difficult to find opportunities for customers with moderate operating hours like office buildings or retail. Idaho Power staff are aware of this concern and continue investigating options for customers with fewer hours of operation that want to implement energy-efficient projects, particularly new LED fixtures. COVID-19 COVID-19 has not had a prolonged adverse effect on the contractors we interviewed. However, there were a couple of contractors that worked with Retrofits projects in the past that retired or closed their businesses. Although there have been supply delays, contractors felt that customers are adjusting to them. The primary disruption from the pandemic mentioned by contractors was having to work around customer meetings using virtual tools such as Webex and Zoom. Contractors prefer to meet face-to-face with customers. They also appreciated the in-person meetings and training sponsored by Idaho Power to update them on the CIEE programs. They found those meetings useful and a good source of information and interaction. All the firms felt it would be good to continue meetings to discuss program requirements and get new firms up to speed. Idaho Power Company 2021 Home Energy Idaho Power Company 2021 Home Energy Report Program Impact Evaluation ADM Associates, Inc 3239 Ramos Circle Sacramento, CA 95827 916-363-8383 Idaho Power Company 1221 West Idaho St. Boise, ID 83702 208-388-2200 SUBMITTED TO: IDAHO POWER COMPANY SUBMITTED BY: ADM ASSOCIATES, INC. SUBMITTED ON: SEPTEMBER 26, 2022 ii Prepared by: Sedge Lucas Melissa Kosla Adam Thomas iii Acknowledgements We would like to thank the staff at Idaho Power Company for their time and effort in contributing to the evaluation of the 2021 Home Energy Report Program. This evaluation was conducted with regular coordination with staff at Idaho Power Company, who provided quick feedback and turnaround to the requests of the evaluation team as well as open and forthright insights into the operations of the program. iv Table of Contents 1 Executive Summary ................................................................................................................ 1 1.1 Conclusions and Recommendations .................................................................. 3 2 Home Energy Report Program ............................................................................................... 6 2.1 Program Background .......................................................................................... 7 2.2 Data Provided ..................................................................................................... 9 3 Impact Evaluation Approach .................................................................................................. 9 3.1 Glossary of Terminology .................................................................................. 10 3.2 Step 1: Data Preparation and Cleaning ............................................................ 10 3.3 Step 2: Validity Testing ..................................................................................... 11 3.4 Step 3: Propensity Score Matching .................................................................. 12 3.5 Step 4: Linear Regression Modeling ................................................................. 12 3.6 Step 5: Double Count Savings Approach .......................................................... 14 3.7 Step 6: Demand Reduction Estimation ............................................................ 15 3.8 Step 7: Attrition Analysis Approach ................................................................. 18 4 Impact Evaluation Results .................................................................................................... 18 4.1 Data Preparation and Cleaning ........................................................................ 18 4.2 Validity Testing Results .................................................................................... 19 4.3 Propensity Score Matching Results .................................................................. 23 4.4 Double Counting Analysis Results .................................................................... 26 4.5 Linear Regression Modeling Results ................................................................ 27 4.6 Demand Reductions ......................................................................................... 52 4.7 Attrition Analysis Results ................................................................................. 54 4.8 Additional Research ......................................................................................... 56 v List of Figures Figure 2-1 IPC HER Participants by County ..................................................................................... 8 Figure 4-1 T5 Average Daily Usage Before Matching ................................................................... 24 Figure 4-2 T5 Average Daily Usage After Matching ...................................................................... 25 Figure 4-3 T1 Group PY2021 Monthly Household Savings Before Adjustments .......................... 30 Figure 4-4 T2 Group PY2021 Monthly Household Savings Before Adjustments .......................... 34 Figure 4-5 T3 Group PY2021 Monthly Household Savings Before Adjustments .......................... 38 Figure 4-6 T4 Group PY2021 Monthly Household Savings Before Adjustments .......................... 42 Figure 4-7 T5 Group PY2021 Monthly Household Savings Before Adjustments .......................... 46 Figure 4-8 T6 PY2021 Monthly Household Savings Before Adjustments ..................................... 50 Figure 4-9 Typical Annual Load Profile ......................................................................................... 53 Figure 4-10 Typical Daily Load Profile ........................................................................................... 53 Figure 4-11 PY2021 Monthly Moveout Rates by Group ............................................................... 56 Figure 4-12 T1 Year-After-Year Savings ........................................................................................ 58 Figure 4-13 T2 Year-After-Year Savings ........................................................................................ 58 Figure 4-14 T3 Year-After-Year Savings ........................................................................................ 59 Figure 4-15 T4 Year-After-Year Savings ........................................................................................ 59 Figure 4-16 T5 Year-After-Year Savings ........................................................................................ 60 Figure 4-17 T6 Year-After-Year Savings ........................................................................................ 60 Figure 4-18 Proportion of Households with Missing Benchmarks ............................................... 63 vi List of Tables Table 1-1 Summary of Idaho Power Company Home Energy Report Program ............................. 1 Table 1-2 Summary of HER Program Savings During PY2021 ......................................................... 3 Table 2-1: Summary of Idaho Power Company Home Energy Report Program Groups ............... 6 Table 2-2: Idaho Power Company Home Energy Report Program Group Size ............................... 7 Table 2-3: Summary of Proposed Group Organization ................................................................... 7 Table 3-1 Weighted Treatment and Control Customers .............................................................. 11 Table 4-1 Treatment Customers by Restriction ............................................................................ 19 Table 4-2 T1 Group T-Test Results ................................................................................................ 20 Table 4-3 T2 Group T-Test Results ................................................................................................ 20 Table 4-4 T3 Group T-Test Results ................................................................................................ 21 Table 4-5 T4 Group T-Test Results ................................................................................................ 21 Table 4-6 T5 Group T-Test Results ................................................................................................ 22 Table 4-7 T6 Group T-Test Results ................................................................................................ 22 Table 4-8 PSM Customer Matches, T5 Group ............................................................................... 24 Table 4-9 PSM Covariate Summary, T5 ......................................................................................... 25 Table 4-10 T5 Post Matching T-Test of Difference in Usage by Month ........................................ 26 Table 4-11 PY2021 Downstream Double Counting Results .......................................................... 27 Table 4-12 Regression Parameters ............................................................................................... 27 Table 4-13 T1 Group PY2021 Regression Results ......................................................................... 29 Table 4-14 T1 Group Model Fit ..................................................................................................... 29 Table 4-15 T1 Group PY2021 Monthly Savings Summary ............................................................ 31 Table 4-16 T1 Group Ex-Post Annual kWh Savings ....................................................................... 31 Table 4-17 T1 Group Total Program Year Savings ........................................................................ 31 Table 4-18 T2 Group PY2021 Regression Results ......................................................................... 33 Table 4-19 T2 Group Model Fit ..................................................................................................... 33 Table 4-20 T2 Group PY2021 Monthly Savings Summary ............................................................ 35 Table 4-21 T2 Group Ex-Post Annual kWh Savings ....................................................................... 35 Table 4-22 T2 Group Total Program Year Savings ........................................................................ 35 Table 4-23 T3 PY2021 Regression Results .................................................................................... 37 Table 4-24 T3 Group Model Fit ..................................................................................................... 37 vii Table 4-25 T3 Group PY2021 Monthly Savings Summary ............................................................ 39 Table 4-26 T3 Group Ex-Post Annual kWh Savings ....................................................................... 39 Table 4-27 T3 Group Total Program Year Savings ........................................................................ 39 Table 4-28 T4 Group PY2021 Regression Results ......................................................................... 41 Table 4-29 T4 Group Model Fit ..................................................................................................... 41 Table 4-30 T4 Group PY2021 Monthly Savings Summary ............................................................ 43 Table 4-31 T4 Group Ex-Post Annual kWh Savings by Program Year ........................................... 43 Table 4-32 T4 Group Total Program Year Savings by Evaluation Period ...................................... 43 Table 4-33 T5 Group PY2021 Regression Results ......................................................................... 45 Table 4-34 T5 Group Model Fit ..................................................................................................... 45 Table 4-35 T5 Group PY2021 Monthly Savings Summary ............................................................ 47 Table 4-36 T5 Group Ex-Post Annual kWh Savings ....................................................................... 47 Table 4-37 T5 Group Total Program Year Savings ........................................................................ 47 Table 4-38 T6 Group PY2021 Regression Results ......................................................................... 49 Table 4-39 T6 Group Model Fit ..................................................................................................... 49 Table 4-40 T6 Group PY2021 Monthly Savings Summary ............................................................ 51 Table 4-41 T6 Group Ex-Post Annual kWh Savings by Program Year ........................................... 51 Table 4-42 T6 Group Total Program Year Savings by Evaluation Period ...................................... 51 Table 4-43 PY2021 Program Savings Summary ............................................................................ 52 Table 4-44 Demand Reductions by Group .................................................................................... 54 Table 4-45 Program Reallocation Rates by Program Year ............................................................ 55 Table 4-46 PY2021 Moveout Rates by Group ............................................................................... 55 Table 4-47 T5 Year-After-Year Savings ......................................................................................... 57 Table 4-48 T5 Contribution to 2021 Program Savings .................................................................. 57 Table 4-49 Customer Generation Conversion by Group .............................................................. 61 Table 4-50 Benchmarking Flags Summary .................................................................................... 62 1 Executive Summary This report is a summary of the evaluation, measurement, and verification (EM&V) effort of the 2021 program year (PY2021) Home Energy Report program for Idaho Power Company (IPC). The evaluation was administered by ADM Associates, Inc (herein referred to as the “Evaluators”). The Evaluators estimated the energy impacts of the Home Energy Report Program through a usage analysis with linear regression and statistically valid comparison groups. The Evaluators collected data for the evaluation through review of program materials, acquisition of program tracking data, and collection of historical energy consumption data. Table 1-1 summarizes the number of residential customers the Home Energy Reports were deployed to in the IPC service area since program inception. This table presents the original customer counts in each treatment and control group (group), including control customers in groups T1-T5 that were reassigned to group T6 in 2020. Table 1-1 Summary of Idaho Power Company Home Energy Report Program Group Treatment Customers Control Customers T1 7,900 16,558 T2 5,826 5,826 T3 8,501 49,727 T4 4,101 46,191 T5 6,501 75,801 T6 108,498 14,744 Total 141,327 208,847 The Evaluators present positive and statistically significant savings estimates for all groups evaluated. Executive Summary Idaho Power Company Impact Evaluation Report Executive Summary 2 Table 1-2 provides a summary of evaluated savings of the IPC Home Energy Report program for the 2021 calendar year. The table presents the average annual household savings estimate and the program savings estimate for each group. During PY2021, the average annual household savings was 172 kWh with a total program energy savings of 18,386,281 kWh and total demand reductions of 2,275.19 kW. The Home Energy Report Program displayed a realization rate of 109.65% compared to the expected savings of 16,767,446 kWh for the 2021 program year. Executive Summary Idaho Power Company Impact Evaluation Report Executive Summary 3 Table 1-2 Summary of HER Program Savings During PY2021 Group Weighted Treatment Customers Average Annual Household Savings (kWh) Total Program Savings (kWh) Total Program Demand Reductions (kW) T1 4,949 243.92 1,207,146 149.32 T2 4,320 297.71 1,286,194 159.09 T3 5,024 263.69 1,324,882 163.97 T4 2,356 262.99 619,579 76.68 T5 1,646 510.58 840,397 104.01 T6 88,827 147.57 13,108,083 1,622.13 Total 107,122 171.64 18,386,281 2,275.19 *The Evaluators used the weighted number of active treatment customers in 2021 to produce ex-post measure savings 1.1 Conclusions and Recommendations The Evaluators offer the following conclusions and recommendations for consideration in planning future program cycles. 1.1.1 Conclusions ◼ The Evaluators estimated Home Energy Report Program savings for Idaho Power Company through usage analysis of randomized control trial (RCT) groups and matched control groups. The Evaluators also estimated demand reductions for each group. The Evaluators found positive annual savings that are statistically significant for all groups in PY2021. ◼ Due to low propensity for energy savings for the T5 group, the group stopped receiving reports in April 2020. Despite this, Evaluators included participants who had been a part of this group in their 2021 usage analysis. Overall savings including and excluding these T5 persistence savings are outlined below. ◼ The Evaluators verified 17,545,884 kWh savings for PY2021 for T1, T2, T3, T4, and T6. When including the T5 persistence savings, the Evaluators verified 18,386,281 kWh savings for PY2021. The Home Energy Report Program displayed a realization rate of 109.65% compared to the expected savings of 16,767,446 kWh for the 2021 program year. ◼ All evaluated groups displayed average annual electric savings between 0.99% and 5.21% of annual billed use in PY2021. Typical behavioral programs display average annual electric savings between 1% and 3%. Therefore, savings verified in PY2021 meet or exceed those typically displayed in behavioral programs. The Idaho Power Company Home Energy Report Program continues to meet or exceed typical behavioral program savings expectations for each consecutive program year. ◼ The T5 group stopped receiving reports in April 2020 because the program implementer did not detect statistically significant savings during the pilot period of August 2017 through December 2019. ADM conducted evaluation efforts to confirm whether this group displays statistically significant savings in the 2021 program year. For the 2021 program year evaluation of this group, an ad-hoc counterfactual group was created via propensity score matching due to Executive Summary Idaho Power Company Impact Evaluation Report Executive Summary 4 invalidity of the original RCT groups. Natural attrition may have caused the group or a portion of the group to no longer be statistically comparable in the pre-period(before the household starts receiving home energy reports) . The Evaluators employed propensity score matching using the nearest match algorithm at a one-to-one matching ratio and had a considerable pool of control customers to draw upon. The Evaluators selected a group that passed equivalency testing for all 12 pre-period months. This group was employed in regression analysis to estimate T5 group persistence savings. In order to ensure no double counting of observable savings from the regression results, the Evaluators summarize and remove other program savings from the resulting regression results, attributable to customers who also participated in IPC’s Home Energy Report Program. The Evaluators estimated total other program savings as the amount of savings claimed through all other residential programs offered through Idaho Power Company. The Evaluators estimated downstream double counted savings at -81,444 kWh for PY2021. This contributed to a reduction of total program savings by 0.44%. This is in line with expectations that double counted savings range between -2% and 2% reductions to total program savings for a behavioral program. Each estimated amount was parsed by year and removed from the estimated savings from the regression results. ◼ The Evaluators estimated demand reductions for each group in 2021. The Evaluators verified a total of 2,275.19 kW reduction due to the Home Energy Report Program. ◼ The Evaluators conducted attrition analysis. The total attrition for the program since inception is 43.4% for the treatment group and 58.6% for the control group. This number is expected to be large due to the number of years the program has been deployed; T1 and T3-T5, for example, have all been deployed for over 4 years. To calculate this overall attrition, it was assumed that customers maintained their initial treatment assignment, unless they moved out after being reassigned to group 6. The Evaluators found the individual group attrition rates in 2021 to range between 0.0% and 8.7%. The T6 group displays the largest attrition of 8.4% and 8.7% for treatment and control, respectively. This may be due to the COVID-19 pandemic or group stabilization after its initiation in June 2020. That is, the T6 treatment and control groups consist of customers with household behaviors different than those of T1 through T5. The attrition rate indicates that the customers in T6 either have a naturally high attrition rate, or responded to the COVID-19 pandemic with a higher rate of moveouts than other groups. ◼ In 2020, IPC made the decision to stop sending reports to customers who had transitioned from the residential rate schedule (I01) to the customer generation rate schedule (I06). The Evaluators attempted to estimate incremental group savings due to the exclusion of these customers in the analysis. The Evaluators found that when the customer generation customers were removed from each of the groups, the groups no longer remained valid between treatment and control groups. Due to these findings, the Evaluators are unable to provide incremental household savings estimates with and without the customer generation rate schedule conversion customers. The Evaluators recommend that IPC continue to include these customers in the T1 through T6 groups and refrain from reallocating them to another treatment group. This will ensure that all legacy groups remain statistically valid and evaluable. ◼ The Evaluators explored the benchmarking flags aggregated and used by the implementer for use in the Home Energy Report messaging. Because nearly all of IPC’s residential customer base Executive Summary Idaho Power Company Impact Evaluation Report Executive Summary 5 is currently designated to either a treatment or control group, the lack of household characteristics in this benchmarking dataset provide no barriers for participation in the program. The Evaluators recommend that if a group is designed for the program in the future, that the lack of benchmarking characteristics is not used as a prerequisite for participation. 1.1.2 Recommendations ◼ The Evaluators recommend that IPC and the implementer continue to prioritize the validity of each treatment and control group in order to maintain ability to estimate program savings. Previous changes throughout the program have resulted in maintenance of group validity due to additional steps relating to randomization, validity checks, and prioritization of statistical validity. The Evaluators recommend IPC continue such efforts to ensure future program savings are evaluable and quantifiable. ◼ Although the pilot phase of the program indicated that low to medium annual energy users displayed low propensity for energy savings, the Evaluators found that these users (group T5) have displayed high persistence savings in recent years. Therefore, the Evaluators recommend that IPC allow customers with low to medium annual energy use to be eligible for participation in the program for any and all future group expansions. ◼ The Evaluators recommend that IPC continue to include customers that have converted from I01 rate schedule to I06 rate schedule in the T1 through T6 groups and refrain from reallocating them to another treatment group. This will ensure that all legacy groups remain statistically valid and evaluable. ◼ The Evaluators recommend that if a group is designed for the program in the future, that the lack of benchmarking characteristics is not used as a prerequisite for participation. This will ensure that the maximum number of customers are eligible for the Home Energy Report Program and therefore the program retains higher potential for total program energy savings. 2 Home Energy Report Program The IPC’s Home Energy Report Program began providing Home Energy Reports (HERs) in 2017 to a portion of residential customers. The program was designed to provide information to residential customers intended to encourage behavioral changes that result in reduced billed energy consumption. The household receives personalized information about their own kWh consumption and comparison to a group of neighboring households energy consumption. Also included on the reports is information on other IPC energy efficiency programs to encourage additional home improvements towards reduced energy usage. This normative information on electric usage and targeted tips on energy saving behaviors is aimed to reduce the participant household’s energy consumption. Since the launch of a pilot program in August 2017 with three groups (T3-T5), the program had expanded into a total of six groups. A description of each of these groups along with their initial intervention date is outlined in Table 2-1. Table 2-1: Summary of Idaho Power Company Home Energy Report Program Groups Group Description Customer Type Intervention Date T1 Winter Heating Group Customers with high winter use (electric heating) added in Year 1 of the pilot December 2017 T2 Winter Heating Group Customers with high winter use (electric heating) added in Year 2 of the pilot December 2018 T3 Year-Round Group Customers with high year-round energy use added in Year 1 of the pilot August 2017 T4 Year-Round Group Customers with medium year-round energy use added in Year 1 of the pilot August 2017 T5 Year-Round Group Customers with low year-round energy use added in Year 1 of the pilot August 2017 T6 Expansion Group Expansion customers based on eligibility criteria determined after the pilot June 2020 The program employs the third-party implementation contractor, Aclara. The pilot program was renewed for a second year in August 2018 with the addition of a second winter heating group and the optimization of existing treatment customers from pilot year one. Year two of the pilot was extended from August 2019 through February 2020 to ensure continuity of treatment. Subsequently, the HER Program was expanded for 3.5 more years – through December 31, 2023. In 2020, the program was expanded from approximately 25,000 customers to over 100,000 with a calculated savings of 10,428 MWh. The HER Pilot Program transitioned into a full program when the expansion group was implemented in 2020. Home Energy Report Program 7 Table 2-2 summarizes the size of the groups implemented in the Home Energy Report program within the IPC service area. Table 2-2: Idaho Power Company Home Energy Report Program Group Size Group Treatment Group Size Control Group Size Number in Group Number at EOY 2021 Number in Group Number at EOY 2021 T1 7,900 5,625 16,558 7,566 T2 5,826 4,578 5,826 2,831 T3 8,501 5,948 49,727 18,455 T4 4,101 2,812 46,191 19,725 T5 6,501 5,022 75,801 75,536 T6 108,498 94,171 14,744 14,730 Total 141,327 118,156 208,847 138,843 The Evaluators estimated savings for Home Energy Report Program using a matched control group of non- participating residences in IPC’s service territory. The Evaluators analyzed each of the groups treated during the 2021 program year. The results are summarized on a calendar year basis (i.e., January through December). Table 2-3 describes the evaluation period for each group and reporting period. Table 2-3: Summary of Proposed Group Organization Group Intervention Date Pre-Period Post-Period T1 December 2017 12/01/16 - 11/31/17 1/1/2021 to 12/31/2021 T2 December 2018 12/01/17 - 11/31/18 T3 August 2017 08/01/16 - 07/31/17 T4 August 2017 08/01/16 - 07/31/17 T5 August 2017 08/01/16 - 07/31/17 T6 June 2020 06/01/19 - 05/31/20 2.1 Program Background This IPC Home Energy Report Program has been a joint effort between IPC, Aclara, and Aclara’s subcontractor, Uplight, since its outset in August 2017. The program was implemented by Aclara/Ecotagious from 2017 through 2019. Starting early 2020, the program has been implemented by Uplight. Throughout this program’s implementation changes, DNV was employed as a third-party consultant to ensure control groups remained randomized and valid against the treatment groups. Initially, the implementors sent bimonthly energy reports to a subset of customers, while others received seasonal energy reports (one report in each November, December, January, and February). However, due to a lack of meaningful savings benefits from bimonthly reports, beginning in February 2020, IPC made the decision to begin sending quarterly reports to all current pilot participants. Home Energy Report Program 8 Expansion participants received bi-monthly reports between June 2020 and February 2021 and then started receiving quarterly reports from that point forward. In PY2020, most reports were delivered as printed and mailed reports (99.5%), with the remaining reports delivered via email (0.05%). In April 2020, the T5 group stopped receiving reports due to low energy savings during the group’s first two pilot years. Given that this group could have a negative impact on program wide cost-effectiveness, the implementers stopped sending reports to the group and removed treatment and control customers from eligibility for selection in future expansion groups. The most recent expansion group is T6 which was implemented in June 2020. DNV randomly removed 75,973 customers from the treatment group’s corresponding control groups (C1, C2, C3, and C4) to free them up for possible treatment in T6. DNV determined how many customers could be removed from these control groups to still maintain statistical significance in pre-period savings. This new expansion group was created after participants passed eligibility screenings. Customers included for potential selection of T6 customers were: (1) nonparticipants (customers that had never previously been selected for T or C for any group in the program) and (2) the 75,973 control group customers removed by DNV- GL. This potential pool totaled to 108,498 customers. A total of 107,088 of these customers were designated to the group T6, after completing eligibility and benchmarking screenings. The addition of this group led to a total of 125,216 treatment customers in PY2020. Participant households in IPC’s HER program spanned 24 counties and 104 unique zip codes. Each zip code had a mean of 2,700 participants, a median of 733, a minimum of 3 in 83250 and a maximum of 17,983 individuals in 83646. A map of IPC’s HER service area is outlined below in Figure 2-1. Figure 2-1 IPC HER Participants by County Impact Evaluation Approach 9 2.2 Data Provided IPC provided the following data to support the analysis: ◼ Daily electric usage data from January 1, 2016 – December 31, 2021, that included customer kWh usage for 271,439 participants; ◼ Customer mapping data that tracked intervention dates, groups, treatment statuses, evaluation removal reasons/dates, and program removal reasons/dates for all participants; ◼ Customer home characteristic data that included geographical data on each house like the county and zip code, basic home information including number of bedrooms, construction year, home type, and square footage, as well as binary data on home amenities including AC and electric space heating; ◼ Other program data that tracks yearly reported savings by program and measure for 130,694 participants. 3 Impact Evaluation Approach This section describes the gross impact evaluation of the Home Energy Report program. The Evaluators analyzed each of the groups treated during the 2021 program years. The Evaluators used participant and control group usage data in the pre-period (before the household starts receiving home energy reports) and in the post-period (after household starts receiving home energy reports) to estimate program impact for each group as part of the Evaluator’s impact evaluation for the Home Energy Report Program, as detailed in the Uniform Methods Project (UMP) behavioral chapter by the National Renewable Energy Laboratory1. In addition, the Evaluators estimated joint savings from other downstream energy efficiency programs offered to IPC’s residential customers. The work effort was divided into six distinct steps: 1. Data preparation and cleaning; 2. Validity testing of remaining treatment and control groups during the baseline period; 3. Create matched ad-hoc control group via propensity score matching for groups where validity was compromised; 4. Estimate monthly and annual billed consumption differences between treatment and control groups via regression modeling; 5. Estimate and remove joint savings from other programs; 6. Estimate demand reductions; and 7. Estimate program attrition. 1 https://www.nrel.gov/docs/fy18osti/70472.pdf Impact Evaluation Approach 10 The Evaluators explored several linear regression models for the impact evaluation of the Home Energy Report program. Each approach involves panel linear regression models to estimate energy savings for the treatment group. The explored methods required monthly usage data for the program participants and a comparable counterfactual group. A designated control group was created by the Evaluators in instances where the control group as designed does not pass equivalency checks. The following types of linear free energy relationships (LFER) models were explored during the evaluation of this program: Difference in Difference (D-in-D) with monthly controls, D-in-D with weather controls, and Post-Program Regression (PPR) models. The UMP recommends D-in-D as it uses data from the treatment and control groups during the pre- and post-period and therefore obtains more precise savings estimates. The PPR model is a panel regression model that calculates the differences between treatment and control consumption in the post‐program period. However, it includes controls on lagged energy use for the same calendar month (for IPC, lagged bi-monthly) of the pre‐program period to include in the model any small systematic differences in pre-treatment usage trends between the participant and control customers. The final model specification used to present the evaluated savings is the D-in-D with monthly controls, as it displayed sufficient fitness and does not require forecasting with independent weather variables. This specification is recommended by the UMP to obtain precise savings estimates by comparing the treatment and control groups during the pre- and post-periods. The Evaluators present savings estimates in three formats for each program year: ◼ Daily and annual energy savings per home ◼ Annual percent savings per home ◼ Program-level savings 3.1 Glossary of Terminology The following section contains a glossary of terminology used throughout the report. ◼ Ex-ante Savings – Calculated savings used for program and portfolio planning purposes. ◼ Ex-post Savings – Savings estimates reported by an evaluator after the energy impact evaluation has been completed. ◼ Gross Savings – The change in energy consumption directly resulting from program-related actions taken by participants in an efficiency program, regardless of why they participated. 3.2 Step 1: Data Preparation and Cleaning This section describes the steps the Evaluators performed to prepare data for the usage analysis. The daily usage data the Evaluators received outlined the kWh energy usage by each participant from the start of 2016 until the end of 2021. Using the unique SDP IDs (meter device locations) associated with each participant, the Evaluators merged this usage data with both the customer mapping and housing data. After producing this merged dataset, the Evaluators grouped the daily usage data into monthly Impact Evaluation Approach 11 buckets, tracking both the average and total usage per month. These clean monthly data were then filtered using the following criteria: ◼ Customer months with less than one billed day or more than the total number of days in that calendar month were excluded from analysis. ◼ Customer months present after a customer’s move out date were excluded from analysis. ◼ Customer months with average daily usage greater than 200 kWh were excluded from analysis. ◼ Customer months with average daily usage less than 0 kWh were excluded. ◼ Pre-treatment data were limited to the 12 months prior to the treatment start date for each experimental group. ◼ Customers without at least 9 of the 12 months of pre-period data, as well as at least 9 of the 12 months of post-period data were removed from analysis. Although energy consumption data was provided at daily intervals aggregated from hourly meter data, ADM aggregated this data into monthly format for use in this evaluation. For the remainder of the report, the Evaluators will reference the usage data as having monthly intervals. The Evaluators identified high outliers at the threshold of average daily kWh usage over 200 kWh per day. This level of consumption is unrealistic for residential households and can reasonably be categorized as the result of a reading error rather than a valid reading from a high user. The Evaluators aimed to remove error reading rather than remove high and low users, as these subgroups contribute real behaviors to the average savings estimate. The usage data provided by IPC is summarized in the table below. Table 3-1 displays the original and final number of Home Energy Report participants and nonparticipants used in the calculation of the methodologies below. Table 3-1 Weighted Treatment and Control Customers Group Original Treatment Customers Original Control Customers Weighted Treatment Customers 2021 Weighted Control Customers 2021 T1 7,900 16,558 4,949 1,222 T2 5,826 5,826 4,320 693 T3 8,501 49,727 5,024 2,994 T4 4,101 46,191 2,356 2,213 T5 6,501 75,801 1,646 36,480 T6 108,498 14,744 88,827 12,065 Total 141,327 208,847 107,122 55,667 After data preparation and cleaning, the Evaluators performed validity testing for all groups evaluated. The details of this step are provided in the next section. 3.3 Step 2: Validity Testing The method for evaluation requires the counterfactual group remains statistically valid for each treatment group. Validity is tested by examining each energy consumption read in the pre-treatment Impact Evaluation Approach 12 period for customers in each the treatment and control group. Each calendarized monthly is tested for statistically significant differences using a simple two-tailed T-test. The evaluators performed equivalency for each month between the provided RCT treatment group and the provided RCT control group. The Evaluators tested the validity of each RCT by completing t-tests for the average daily usage of each of the pre-period months between the remaining treatment group and remaining control. If the pre- period average daily usage rejected the null hypothesis at the 95% confidence interval for a number of the 12 pre-period months, the RCT was considered invalid. To gather the most reliable results, it is ideal to have a RCT. However, due to changes in program implementation, the original RCT may not be feasible. For groups that do not pass equivalency testing, the Evaluators performed propensity score matching (PSM) to create a post-hoc control group comprising of participants that have not received home energy reports. The control group created undergoes equivalency testing to confirm it is statistically comparable to the treatment group in pre- period usage. 3.4 Step 3: Propensity Score Matching Due to complications in program implementation or design (or as the result of significant participant attrition), the RCT groups may have become invalid. Regression model analyses are unable to be run on groups in which a statistically comparable control group is not defined. Therefore, in order to analyze groups that have non-equivalent counterfactual groups, a post-hoc control group is required to be created. The Evaluators created a statistically similar control group using propensity score matching (PSM), a method that allows the Evaluators to find the most similar household based on the customers’ billed consumption trends in the pre-period and verified with statistical difference testing. A propensity score is a metric that summarizes several dimensions of household characteristics into a single metric that can be used to group similar households. To create a post-hoc control group, the Evaluators compiled usage data of all control participants from all groups to compare against treatment households via quasi-experimental methods. This allowed the Evaluators to select from a large group of similar households that have not received home energy reports. With this information, the Evaluators matched the treatment group to a similar control group via seasonal pre-period usage. After matching, a t-test was conducted for each month in the pre-period to help determine the success of PSM. After creating a PSM control group, the group undergoes the same regression modeling as the remaining statistically valid group. The regression specifications and details are summarized in the next section. 3.5 Step 4: Linear Regression Modeling The Evaluators utilized a linear regression model that compares the treatment group and valid comparison group in a D-in-D regression model. The comparison control group used was either created during the RCT design or was the result of propensity score matching conducted by the Evaluators. This requires a successful validation test between the group’s treatment and comparison group. This Impact Evaluation Approach 13 approach, with randomized control trial, is detailed in the UMP as a preferred method for evaluation of opt-out behavioral programs. The following sections summarize the model specification the Evaluators utilized to estimate impact savings for the program. 3.5.1 Difference-in-Difference Model Specification The fixed-effects linear regression model specification contains customer-specific dummy variables to account for exogenous heterogeneity that cannot be explicitly controlled for and is not relevant to the estimation of program savings. The specification of customer specific effects allows the model to capture much of the baseline differences across customers while obtaining reliable estimates of the impact of the report. The Evaluators fit a monthly fixed effects panel regression model to estimate daily consumption differences between treatment and control households in each month. The model specifications used in this analysis is described below. Equation 3-1: Fixed-Effects Difference-in-Difference (D-in-D) Panel Regression Model Specification 𝐴𝐷𝐶𝑖𝑡=𝛼0 +𝛽1(𝑃𝑜𝑠𝑡)𝑖𝑡+𝛽2(𝑃𝑜𝑠𝑡× 𝑀𝑜𝑛𝑡ℎ)𝑖𝑡+𝛽3(𝑇𝑟𝑒𝑎𝑡𝑚𝑒𝑛𝑡× 𝑃𝑜𝑠𝑡)𝑖𝑡 +𝛽4(𝑇𝑟𝑒𝑎𝑡𝑚𝑒𝑛𝑡× 𝑃𝑜𝑠𝑡× 𝑀𝑜𝑛𝑡ℎ)𝑖𝑡+𝜀𝑖𝑡 Where, 𝐴𝐷𝐶𝑖𝑡 = Estimated average daily consumption (dependent variable) in home i during period t 𝑃𝑜𝑠𝑡𝑖𝑡 = Dummy variable indicating whether period t was in pre- or post- retrofit 𝑇𝑟𝑒𝑎𝑡𝑚𝑒𝑛𝑡𝑖 = Dummy variable indicating whether household i was in treatment group or control group 𝑀𝑜𝑛𝑡ℎ𝑖𝑡 = Dummy variable indicating month during period t 𝜀𝑖𝑡 = Customer-level random error 𝛼0= The model intercept for home i 𝛽1−4 = Coefficients determined via regression The coefficients 𝛽3 and 𝛽4 represent the average change in consumption between the treatment group and the control group in the post-period. Monthly kWh savings are then taken by using the following equation: Equation 3-2: Monthly kWh Savings 𝑚𝑜𝑛𝑡ℎ𝑙𝑦𝑠𝑎𝑣𝑖𝑛𝑔𝑠𝑡= −1 ∗ 𝛽4𝑡∗𝑑𝑎𝑦𝑠𝑡∗𝑝𝑎𝑟𝑡𝑖𝑐𝑖𝑝𝑎𝑛𝑡𝑠𝑡 Where: 𝑡 = a given month in the program year, 𝛽1𝑡 = the regression coefficient for the treatment effect of month 𝑡 in the post-period 𝑑𝑎𝑦𝑠𝑡 = the number of days in the given month Impact Evaluation Approach 14 𝑝𝑎𝑟𝑡𝑖𝑐𝑖𝑝𝑎𝑛𝑡𝑠𝑡 = the number of active participants in month 𝑡 Because the regression equation predicts average daily usage as a function of the treatment effect, and the treatment indicator has been coded as “1”, the regression coefficient for the treatment effect of a given month should be negative if savings occurs. Therefore, multiplying the savings calculation by -1 will correct the sign of the results. 3.6 Step 5: Double Count Savings Approach Participants in both the treatment and control groups participate in other Idaho Power Company energy efficiency programs. The IPC HER program reports may also increase the customer’s propensity to participate in other programs. This additional participation is known as uplift. The HER sent to customers includes information about other IPC incentives and programs, which may lead to customers adopting more energy efficient upgrades for their home. When a household participates in an efficiency program because of this encouragement, the utility might count their savings twice: once in the regression-based estimate of HER program savings and again in the estimate of savings for the other energy efficiency program. Although uplift rarely displays a statistically significant difference between the treatment and control groups, the UMP recommends removing uplift from each group at the household level. The double counted savings, whether positive or negative, are subtracted from the group’s savings estimates from the regression analysis to get total verified savings. IPC’s double counted savings are exclusively downstream. The following section details our proposed methodology for calculating those savings. 3.6.1 Downstream Downstream programs traditionally track installed measures at the customer level. IPC delivered customer-level tracking data with verified savings estimates from other programs IPC offers to customers in the HER program. The Evaluators included all residential IPC programs in the double counting analysis. The Evaluators corrected for cross-program participation that occurred after treatment began to the extent that the treatment group participated at a higher rate than the control group. The Evaluators estimated and subtracted savings from program uplift from the total program portfolio savings for each program year. The double count savings were calculated on a per-household level for each treatment group in each group as follows: Equation 3-3 Double Count Specification 𝐷𝑜𝑢𝑏𝑙𝑒 𝐶𝑜𝑢𝑛𝑡𝑖𝑛𝑔= (𝑂𝑃 𝑘𝑊ℎ 𝐻𝑜𝑢𝑠𝑒ℎ𝑜𝑙𝑑𝑇𝑟𝑒𝑎𝑡𝑚𝑒𝑛𝑡 −𝑂𝑃 𝑘𝑊ℎ 𝐻𝑜𝑢𝑠𝑒ℎ𝑜𝑙𝑑𝐶𝑜𝑛𝑡𝑟𝑜𝑙 )× # 𝐴𝑐𝑐𝑜𝑢𝑛𝑡𝑠𝑇𝑟𝑒𝑎𝑡𝑚𝑒𝑛𝑡 Where, 𝑂𝑃 𝑘𝑊ℎ 𝐻𝑜𝑢𝑠𝑒ℎ𝑜𝑙𝑑𝑇𝑟𝑒𝑎𝑡𝑚𝑒𝑛𝑡= Other program kWh per household in the treatment group Impact Evaluation Approach 15 𝑂𝑃 𝑘𝑊ℎ 𝐻𝑜𝑢𝑠𝑒ℎ𝑜𝑙𝑑𝐶𝑜𝑛𝑡𝑟𝑜𝑙 = Other program kWh per household in the control group # 𝐴𝑐𝑐𝑜𝑢𝑛𝑡𝑠𝑇𝑟𝑒𝑎𝑡𝑚𝑒𝑛𝑡 = Total accounts in the treatment group To estimate double counted program savings from downstream program uplift, the Evaluators: 1. Matched the HER program treatment and control group customers to the utility energy efficiency program tracking data by customer ID or address 2. Calculated the savings per treatment group subject from efficiency uplift as the difference between treatment and control groups in average efficiency program savings per subject 3. Multiplied that difference by the number of subjects who are in the treatment group The Evaluators summarized and removed program uplift for each group and treatment status for each of the other residential program offerings. 3.7 Step 6: Demand Reduction Estimation The relationship between annual usage savings and peak demand savings has not been defined for HERs. Program savings rely on hourly meter data provided by IPC. Although smart meter data (hourly usage data) are available for IPC residential customers, the data delivery method was inadequate for proper transfer of this high-resolution data. Therefore, the Evaluators utilized daily consumption data, aggregated to monthly consumption data for each customer. Thus, the resolution of billing data provided for analysis is unsuitable for the direct evaluation of peak demand savings. However, it can be assumed that total monthly usage can be attributed to the usage of other residential components (e.g., HVAC, lighting, etc.) and that any reduction in usage is proportional to the overall usage of these components. Load factors are available for these components at an hourly resolution; thus, the Evaluators have developed a model for predicting coincident peak demand savings from component load factors from the gross energy savings calculated using the above methodology. The demand reductions claimed through the AC Cool Credit Program displays no statistically significant differences between the treatment and control groups. Therefore, the Evaluators did not remove demand reductions claimed through the AC Cool Credit Program, as incremental kWh and kW savings are unmeasurable between the groups. 3.7.1 Normalize kWh Usage In order to increase the generalizability of the model, the Evaluators will first normalize the kWh savings value predicted by the impact evaluation regression model into a percent savings value by dividing each month’s savings by the total annual savings. Equation 3-4 Monthly Savings Normalization Calculation % 𝑠𝑎𝑣𝑖𝑛𝑔𝑠𝑚𝑜𝑛𝑡ℎ 𝑦𝑒𝑎𝑟= 𝑘𝑊ℎ 𝑠𝑎𝑣𝑖𝑛𝑔𝑠𝑚𝑘𝑊ℎ 𝑠𝑎𝑣𝑖𝑛𝑔𝑠𝑦⁄ Where, 𝑚 = Value for given program month m. Impact Evaluation Approach 16 𝑦 = Value for given program year y. 3.7.2 Calculate Monthly Load Factors for Component Variables The model assumes a linear relationship between the component variables and the percent savings calculated above. Because load shape information is available for residential components at an hourly resolution, the Evaluators can estimate the relationship between component load and percent savings in order to estimate total demand savings. To make sure that the model is interpretable, hourly load factors must be converted to monthly load factors. The Evaluators sourced hourly load data from the U.S. Department of Energy Open Data Catalog2 of residential hourly load profiles. The database contains hourly load profiles for all TMY3 locations in the United States. The specific location chosen for this evaluation was the Boise International Airport. 3.7.3 Simple Regression In order to determine the relationship between the percent savings and the component load factors, the Evaluators ran a simple linear regression. Because the model is used to predict savings from known variables, we hold the intercept constant at 0 to ensure that the majority of the variability will be explained by the component load factors. The following equation displays an example regression equation used to predict percent savings attributable to a higher resolution time period. Equation 3-5 Percent Savings Prediction % 𝑆𝑎𝑣𝑖𝑛𝑔𝑠𝑚𝑜𝑛𝑡ℎ 𝑦𝑒𝑎𝑟= 𝛽1 × 𝑙𝑓𝑇𝑜𝑡𝑎𝑙 𝑘𝑊ℎ Where, 𝑙𝑓= Load factor for each component variable of interest 𝑇𝑜𝑡𝑎𝑙 𝑘𝑊ℎ = All end-uses combined The regression coefficients for the above regression equation represent the relationship of each of the component variables to percent savings. Because both independent and dependent variables are calculated in units of months, the numerator of the regression weights are time invariant and can be used to estimate the percentage of savings across any unit of time of interest in a year. 2 https://openei.org/doe-opendata/dataset/commercial-and-residential-hourly-load-profiles-for-all-tmy3-locations-in-the- united-states Impact Evaluation Approach 17 3.7.4 Demand Calculation Coincidence peak load was estimated for the total electric load by summing the total electric load over peak hours as defined by the IPC—non-weekend and non-holiday days between 1:00 p.m. and 9:00 p.m. for the months of June through August and non-weekend non-holiday days between 7:00 a.m. and 9:00 p.m. for the months of September through May3. The following equation illustrates the calculation for calculating the peak load factor. Equation 3-6 Peak Load Factor Calculation 𝑃𝑒𝑎𝑘 𝐿𝑜𝑎𝑑 𝐹𝑎𝑐𝑡𝑜𝑟𝑥= ∑𝐻𝑜𝑢𝑟𝑙𝑦 𝐿𝑜𝑎𝑑 𝐹𝑎𝑐𝑡𝑜𝑟𝑥 𝑛 𝑖=1 Where, 𝑥 = Component variable of interest (total electric load) 𝑖 = First peak hour for the entire annual peak period 𝑛 = Last peak hour for the entire annual peak period Multiplying this value by the total annual savings will then generate the kWh savings that took place during the peak period, as illustrated by Equation 3-7. Equation 3-7 Energy Savings During Peak Period 𝑃𝑒𝑎𝑘 𝑘𝑊ℎ 𝑠𝑎𝑣𝑖𝑛𝑔𝑠=𝑇𝑜𝑡𝑎𝑙 𝑘𝑊ℎ 𝑆𝑎𝑣𝑖𝑛𝑔𝑠 ∙𝑃𝑒𝑎𝑘 𝐿𝑜𝑎𝑑 𝐹𝑎𝑐𝑡𝑜𝑟𝑥 Dividing this value by the total number of peak hours will generate coincident peak demand savings in units of kW, as shown in Equation 3-8. Equation 3-8 Peak Demand Savings 𝑃𝑒𝑎𝑘 𝑘𝑊 𝑠𝑎𝑣𝑖𝑛𝑔𝑠=𝑃𝑒𝑎𝑘 𝑘𝑊ℎ 𝑠𝑎𝑣𝑖𝑛𝑔𝑠 𝐴𝑛𝑢𝑎𝑙 𝑃𝑒𝑎𝑘 𝑃𝑒𝑟𝑖𝑜𝑑 × 𝐴𝑛𝑛𝑢𝑎𝑙 𝑃𝑒𝑎𝑘 𝑃𝑒𝑟𝑖𝑜𝑑 𝑁𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑃𝑒𝑎𝑘 𝐻𝑜𝑢𝑟𝑠 As with gross usage savings, the Evaluators anticipates that some participants in the treatment group will also participate in other IPC programs. The adjusted savings per month is an input for the demand savings estimation with this method. The Evaluators adjust the savings per month by weighing the HVAC measures by degree day. 3 https://www.idahopower.com/accounts-service/understand-your-bill/pricing/idaho-pricing/time-day-plan/frequently- asked-questions/ Impact Evaluation Results 18 3.8 Step 7: Attrition Analysis Approach The tracking of treatment and control households can be affected by either move-outs or opt-outs (known collectively as ‘attrition’). If a household’s final bill was the end of the evaluated post-period, it is considered a move out and bills occurring after moveout will be removed from the analysis. Opt-outs, however, remain in the regression analysis, as the program savings estimated is the “intent-to-treat” savings. It remains useful to estimate attrition to gather information on persistence of savings. The cumulative level of both treatment and control move outs over the program life by month, group, and treatment/control status for each program year was summarized by the Evaluators. This information can be useful for IPC for the potential development of future HER program groups. 4 Impact Evaluation Results This section provides the results of each portion of the impact evaluation. The Evaluators calculated the percent savings per home by dividing the average annual energy savings estimated in the treatment group by the average annual energy consumption from the control group for each program year. That value is then adjusted for uplift from downstream measures. The program-level savings are calculated by multiplying the average annual household impact estimate by the weighted number of active program participants in the treatment group and after removing double counted savings, by program year. 4.1 Data Preparation and Cleaning The Evaluators prepared and cleaned usage data provided by IPC. The following table represents the unique number of customers per group and treatment group throughout the usage cleaning stages. Impact Evaluation Results 19 Table 4-1 Treatment Customers by Restriction Restriction T1 Treatment Customers T2 Treatment Customers T3 Treatment Customers T4 Treatment Customers T5 Treatment Customers T6 Treatment Customers Mapping File 7,900 5,826 8,501 4,101 6,501 108,498 Merged with billing data 7,900 5,826 8,501 4,101 6,501 108,498 Remove intervention month 7,900 5,826 8,501 4,101 6,501 108,498 Subset to 12 months pre and 12 months post 7,900 5,826 8,501 4,101 6,501 108,498 Remove bills present after moveout date for each customer 7,900 5,826 8,501 4,101 6,501 108,498 Remove customers without at least 9 months pre or 9 months post 7,900 5,826 8,501 4,101 6,501 108,498 Remove observations with greater than 200 kWh/day (outlier) 7,900 5,826 8,501 4,101 6,501 108,498 Remove observations with negative consumption 7,900 5,826 8,501 4,101 6,501 108,498 Remove customers removed from evaluation due to optimization, reallocation, moveout 4,964 4,336 5,030 2,356 1,646 88,884 As displayed in the table above, the cleaning steps removed very few customers from the analysis. Although the cleaning steps displayed above had removed individual bills across a number of customers, each customer still displayed 9 valid billing months in each the pre-period and post-period, and therefore were retained in the analysis. However, the last step in the billing analysis removed 25% to 75% of customers within each treatment group due to changes in implementation eligibility. After data preparation and cleaning, the Evaluators performed validity testing for all groups evaluated. The details of this step are provided in the next section. 4.2 Validity Testing Results The remaining groups after usage data preparation and cleaning were tested for statistically significant differences in usage between the treatment and control groups for each of the 12 pre-period months in each group. The tables below detail differences and statistical significance between each group’s treatment and control groups for each of the 12 months in the pre-period. The baseline months listed in each table differ between each group due to differing intervention dates. Impact Evaluation Results 20 Table 4-2 T1 Group T-Test Results Pre-Period Month Treatment Group Average Daily Usage (kWh/day) Control Group Average Daily Usage (kWh/day) Average Daily Usage Difference (kWh/day) P-value Statistically Significant Difference Dec 2016 110.12 109.88 0.24 0.8110 - Jan 2017 117.63 116.72 0.91 0.3684 - Feb 2017 87.94 87.6 0.34 0.6937 - Mar 2017 60.11 60.23 -0.12 0.8566 - Apr 2017 52.06 52.28 -0.22 0.7169 - May 2017 41.67 41.72 -0.05 0.9390 - Jun 2017 42.55 42.26 0.29 0.6531 - Jul 2017 55.49 55.59 -0.10 0.9049 - Aug 2017 48.79 48.54 0.25 0.7394 - Sep 2017 42.62 42.2 0.42 0.4695 - Oct 2017 50.61 50.46 0.15 0.8170 - Nov 2017 64.94 65.2 -0.26 0.7227 - *Statistically significant if p<0.05 Table 4-3 T2 Group T-Test Results Pre-Period Month Treatment Group Average Daily Usage (kWh/day) Control Group Average Daily Usage (kWh/day) Average Daily Usage Difference (kWh/day) P-value Statistically Significant Difference Dec 2017 97.01 97.19 -0.18 0.8737 - Jan 2018 83.29 83.69 -0.40 0.7070 - Feb 2018 83.85 84.43 -0.58 0.5991 - Mar 2018 68.06 68.29 -0.23 0.8182 - Apr 2018 47.87 47.84 0.03 0.9661 - May 2018 34.55 34.10 0.45 0.4750 - Jun 2018 35.35 35.42 -0.07 0.9198 - Jul 2018 45.21 44.84 0.37 0.6923 - Aug 2018 40.09 39.92 0.17 0.8370 - Sep 2018 33.51 33.46 0.05 0.9347 - Oct 2018 44.14 44.19 -0.05 0.9433 - Nov 2018 72.04 73.07 -1.03 0.3127 - *Statistically significant if p<0.05 Impact Evaluation Results 21 Table 4-4 T3 Group T-Test Results Pre-Period Month Treatment Group Average Daily Usage (kWh/day) Control Group Average Daily Usage (kWh/day) Average Daily Usage Difference (kWh/day) P-value Statistically Significant Difference Aug 2016 53.95 53.95 0.00 0.9933 - Sep 2016 37.90 37.67 0.23 0.5414 - Oct 2016 34.56 34.51 0.05 0.8915 - Nov 2016 37.07 37.20 -0.13 0.6947 - Dec 2016 48.86 49.16 -0.30 0.5072 - Jan 2017 48.37 48.55 -0.18 0.7000 - Feb 2017 40.70 40.78 -0.08 0.8278 - Mar 2017 34.94 35.12 -0.18 0.5901 - Apr 2017 33.64 33.64 0.00 0.9946 - May 2017 37.12 37.05 0.07 0.8590 - Jun 2017 46.26 46.31 -0.05 0.9107 - Jul 2017 65.65 65.07 0.58 0.3212 - *Statistically significant if p<0.05 Table 4-5 T4 Group T-Test Results Pre-Period Month Treatment Group Average Daily Usage (kWh/day) Control Group Average Daily Usage (kWh/day) Average Daily Usage Difference (kWh/day) P-value Statistically Significant Difference Aug 2016 36.99 37.43 -0.44 0.2336 - Sep 2016 24.35 24.54 -0.19 0.3759 - Oct 2016 22.82 22.89 -0.07 0.6889 - Nov 2016 24.97 25.02 -0.05 0.8225 - Dec 2016 33.35 33.01 0.34 0.3476 - Jan 2017 33.45 32.80 0.65 0.1217 - Feb 2017 27.78 27.18 0.60 0.0453 * Mar 2017 23.83 23.48 0.35 0.1217 - Apr 2017 22.73 22.42 0.31 0.1614 - May 2017 24.52 24.44 0.08 0.7501 - Jun 2017 31.43 31.67 -0.24 0.4316 - Jul 2017 48.09 48.51 -0.42 0.4109 - *Statistically significant if p<0.05 Impact Evaluation Results 22 Table 4-6 T5 Group T-Test Results Pre-Period Month Treatment Group Average Daily Usage (kWh/day) Control Group Average Daily Usage (kWh/day) Average Daily Usage Difference (kWh/day) P-value Statistically Significant Difference Aug 2016 29.45 27.67 1.78 <0.0000 * Sep 2016 19.03 17.79 1.24 <0.0000 * Oct 2016 17.98 16.92 1.06 <0.0000 * Nov 2016 19.70 18.72 0.98 <0.0000 * Dec 2016 25.70 24.64 1.06 0.0001 * Jan 2017 25.60 24.62 0.98 0.0010 * Feb 2017 21.65 20.76 0.89 0.0001 * Mar 2017 18.83 17.96 0.87 <0.0000 * Apr 2017 18.24 17.15 1.09 <0.0000 * May 2017 19.67 18.37 1.30 <0.0000 * Jun 2017 25.84 24.09 1.75 <0.0000 * Jul 2017 40.79 38.31 2.48 <0.0000 * *Statistically significant if p<0.05 Table 4-7 T6 Group T-Test Results Pre-Period Month Treatment Group Average Daily Usage (kWh/day) Control Group Average Daily Usage (kWh/day) Average Daily Usage Difference (kWh/day) P-value Statistically Significant Difference Jun 2019 36.81 36.77 0.04 0.7989 - Jul 2019 46.81 46.79 0.02 0.9479 - Aug 2019 46.67 46.59 0.08 0.6814 - Sep 2019 34.37 34.22 0.15 0.3093 - Oct 2019 34.49 34.39 0.10 0.5898 - Nov 2019 39.53 39.50 0.03 0.9085 - Dec 2019 45.93 45.90 0.03 0.9029 - Jan 2020 43.39 43.33 0.06 0.8145 - Feb 2020 42.38 42.34 0.04 0.8819 - Mar 2020 36.08 36.03 0.05 0.8004 - Apr 2020 33.57 33.55 0.02 0.9181 - May 2020 33.67 33.64 0.03 0.8235 - *Statistically significant if p<0.05 The RCT for the groups T1-T3 and T6 remained balanced at the 95% confidence level in the entire pre- period. The T4 group meanwhile had a statistically significant difference for one month (February 2017); however, the group as a whole was considered balanced. The Evaluators note that up to two months Impact Evaluation Results 23 rejected of the 12 pre-period months is allowed for validity testing. In contrast, there was a significant difference between the treatment and controls groups for the T5 group for all pre-period months. Therefore, the Evaluators continued with the control group for the T1-T4 and T6 groups and employed propensity score matching in an attempt to create an ad-hoc control group for the T5 group. The result of the propensity score matching is displayed in the section below. 4.3 Propensity Score Matching Results The Evaluators created a valid post-hoc control group for the T5 group via quasi-experimental methods. Quasi-experimental methods are required when the control group has not been randomly assigned as it would be in a RCT. The Evaluators created a statistically similar control group using propensity score matching (PSM), a method that allows the Evaluators to find the most similar household based on the customers’ consumption trends in the pre-period, specifically covariates for average summer, winter, fall, and spring pre-period usage were used and verified with statistical difference testing. A propensity score is a metric that summarizes several dimensions of household characteristics into a single metric that can be used to group similar households. To create a post-hoc control group, the Evaluators compiled usage data of all control participants from all groups to compare against treatment households via quasi-experimental methods. This allowed the Evaluators to select from a large group of similar households that have not received home energy reports. With this information, the Evaluators matched the treatment group to a similar control group on the following variables: ◼ Pre-period spring usage ◼ Pre-period summer usage ◼ Pre-period fall usage ◼ Pre-period winter usage ◼ Customer zip code After matching, a t-test was conducted for each month in the pre-period to help determine the success of PSM. The Evaluators employed propensity score matching using the nearest match algorithm at a one-to-one matching ratio and had a considerable pool of control customers to draw upon, as shown in Table 4-8. The matching ratio defines the number of control customers to be matched to one treatment customer. In addition, the Evaluators allowed replacement of customers, essentially allowing the algorithm to select a control customer for more than one unique treatment customer. The following tables display the number of customers in the resulting matched dataset for the T5 group. Impact Evaluation Results 24 Table 4-8 PSM Customer Matches, T5 Group Status Control Treated All 36,726 1,646 Matched 1,589 1,646 Unmatched 34,911 0 Discarded 226 0 The following figures display the average customer usage between treatment group and control group before and after propensity score matching against the aggregate for all control customers. Figure 4-1 T5 Average Daily Usage Before Matching Impact Evaluation Results 25 Figure 4-2 T5 Average Daily Usage After Matching The difference between the groups for each month decreases after propensity score matching, and the difference between the groups nears 0 for all months for the T5 group, indicating the treatment and control groups are much more similar in terms of energy usage across the pre-period. The tables below present the propensity score covariate summary of pre-period usage for treatment and control customers before and after matching for each of the groups in which propensity score matching was conducted. The standardized mean difference both prior to and after matching is around 1 kWh per day for all covariates. Table 4-9 PSM Covariate Summary, T5 Variable Before Matching After Matching Mean Treated Mean Control Standardized Mean Difference Mean Treated Mean Control Standardized Mean Difference Distance 0.047 0.043 0.215 0.047 0.047 0.001 Pre-period Winter Usage 24.317 23.341 0.099 24.317 24.303 0.001 Pre-period Spring Usage 18.915 17.824 0.188 18.915 18.897 0.003 Pre-period Summer Usage 32.026 30.023 0.179 32.026 32.177 -0.013 Pre-period Fall Usage 18.903 17.809 0.198 18.903 18.822 0.015 The tables below provide the results for a t-test which helps determine the success of matching for each group. The test measures whether there are statistically significant differences in average daily kWh usage between the treatment and control groups in the pre-period by month. Statistically significant Impact Evaluation Results 26 differences occur when the P-Value is less than 0.05 at the 95% significance level. As displayed in the table below, the P-Value is much greater than 0.05 for all 12 pre-period months. This result further indicates propensity score matching performed satisfactorily, as there were no instances for a rejection of the null hypothesis for any of the pre-period months. Therefore, the Evaluators accept this group as a viable match for the T5 group. Table 4-10 T5 Post Matching T-Test of Difference in Usage by Month Pre-Period Month Treatment Group Average Daily Usage (kWh/day) Control Group Average Daily Usage (kWh/day) Average Daily Usage Difference (kWh/day) P-value Statistically Significant Difference Aug 2016 29.45 29.62 -0.17 0.6481 - Sep 2016 19.03 18.95 0.08 0.7004 - Oct 2016 17.98 17.93 0.05 0.7981 - Nov 2016 19.7 19.59 0.11 0.6417 - Dec 2016 25.7 25.79 -0.09 0.8124 - Jan 2017 25.6 25.55 0.05 0.9118 - Feb 2017 21.65 21.57 0.08 0.7819 - Mar 2017 18.83 18.87 -0.04 0.8879 - Apr 2017 18.24 18.16 0.08 0.7104 - May 2017 19.67 19.67 0 0.9826 - Jun 2017 25.84 25.81 0.03 0.9369 - Jul 2017 40.79 41.1 -0.31 0.5819 - After creating a PSM control group, the Evaluators fit a D-in-D and PPR model presented in Equation 3-1 to estimate daily consumption differences between homes that received home energy reports and home that did not receive home energy reports. 4.4 Double Counting Analysis Results Participants in both the treatment and control groups participate in other Idaho Power Company energy efficiency programs. The double counted savings, defined in the methodology, whether positive or negative, are subtracted from the group’s gross savings estimates from the regression analysis to get total verified savings. This section summarizes the results of the double counting analysis for downstream programs. 4.4.1 Downstream IPC delivered tracking data for 10 different programs offered to residential customers. The Evaluators identified and summarized the average treatment customer, average control customer, and average incremental savings attributed to the residential programs for each group. Table 4-11 displays the Impact Evaluation Results 27 verified double counting savings to be subtracted from each group’s annual program savings for each program year. Table 4-11 PY2021 Downstream Double Counting Results Group Average Treatment Household Daily Savings (kWh/day) Average Control Household Daily Savings (kWh/day) Average Incremental Household Daily Savings (kWh/day) Average Annual Household Savings (kWh/year) Weighted Treatment Customers Downstream Program Double Count Savings Contribution to Total Savings T1 0.0337 0.0354 -0.0017 -0.6024 4,949 -2,990 -0.25% T2 0.0230 0.0045 0.0186 6.7758 4,320 29,380 2.23% T3 0.0067 0.0026 0.0041 1.5022 5,024 7,554 0.57% T4 0.0033 0.0006 0.0027 0.9862 2,356 2,323 0.38% T5 0.0018 0.0028 -0.0010 -0.3798 1,646 -625 -0.07% T6 0.0083 0.0119 -0.0037 -1.3173 88,827 -117,087 -0.90% Total 0.0769 0.0578 0.0191 6.9646 107,122 -81,444 -0.44% PY2021 displays a total of -81,444 kWh in double counted savings, contributing a total of -0.44% towards program savings. Therefore, the total program savings declined by 0.44% due to removal of double counted savings. This estimate is in line with expectations that double counted savings contribute between -2% and 2% towards total program savings for a behavioral program. The downstream double counting values are estimated for 2021 other program participation and are subtracted from the regression model results to estimate energy savings as a result of the Home Energy Report Program offered by IPC. 4.5 Linear Regression Modeling Results This section details the regression results of each of the evaluated groups. The T1, T2, T3, T4, and T6 groups were evaluated with the remaining RCT groups. The T5 group was evaluated with the matched control group created via propensity score matching. As discussed in the evaluation approach section, savings are determined through parameters. The coefficients 𝛽3 and 𝛽4 which are defined again in Table 4-12, along with all the other model parameters. Table 4-12 Regression Parameters Variable Parameter Interpretation Post B1 Average daily usage in the post-period Post*Month B2 Average daily usage in month i Treatment*Post B3 Average daily usage for the treatment group in the post-period Treatment*Post*Month B4 Average daily usage in month i in the post-period Impact Evaluation Results 28 Per-home results and percent savings by month and by program year are presented for each of the analyzed groups. Joint savings attributable to IPC downstream programs were calculated and removed to avoid double counting. The Evaluators found all groups to display positive savings that are statistically significant, and each model portrayed a sufficient fitness to the data. 4.5.1 T1 Group Results This section summarizes the results of the persistence study evaluation for the T1 Group. In the table below, the coefficient estimates for Treatment*Post terms (B3) are negative, indicating lower usage per month in the post-period for treatment customers. In addition, these coefficients are statically significant at the 95% level in both program years. The estimates for Treatment*Post*Month (B4) are all positive. The Treatment*Post*Month coefficients are aggregated with the Treatment*Post coefficient, which results in a negative value. This indicates positive energy savings for all months in 2021. Each of the Treatment*Post*Monthly coefficients are statistically significant. This indicates a positive savings effect for home energy report treatment at the 95% confidence interval. Impact Evaluation Results 29 Table 4-13 T1 Group PY2021 Regression Results Coefficient Estimate Std Error P Value 5% 95% Post -6.44 0.2 <0.001 -6.76 -6.12 February -26.53 0.28 <0.001 -26.99 -26.07 March -53.2 0.28 <0.001 -53.66 -52.74 April -62.33 0.28 <0.001 -62.79 -61.87 May -72.55 0.28 <0.001 -73 -72.09 June -70.29 0.28 <0.001 -70.74 -69.83 July -58.01 0.28 <0.001 -58.47 -57.55 August -65.7 0.28 <0.001 -66.15 -65.24 September -72.26 0.28 <0.001 -72.71 -71.8 October -64.44 0.28 <0.001 -64.9 -63.98 November -49.29 0.28 <0.001 -49.75 -48.83 December -6.82 0.28 <0.001 -7.29 -6.36 Treatment*Post -24.7 0.37 <0.001 -25.31 -24.09 Treatment*Post*February 24.22 0.44 <0.001 23.5 24.94 Treatment*Post*March 32.11 0.44 <0.001 31.39 32.83 Treatment*Post*April 27.14 0.44 <0.001 26.43 27.86 Treatment*Post*May 28.24 0.44 <0.001 27.52 28.96 Treatment*Post*June 35.59 0.44 <0.001 34.87 36.31 Treatment*Post*July 30.54 0.44 <0.001 29.82 31.26 Treatment*Post*August 26.83 0.44 <0.001 26.11 27.55 Treatment*Post*September 25.83 0.44 <0.001 25.12 26.55 Treatment*Post*October 24.51 0.44 <0.001 23.79 25.23 Treatment*Post*November 27.1 0.44 <0.001 26.39 27.82 Treatment*Post*December 6.89 0.44 <0.001 6.16 7.61 *Per-household fixed-effects coefficients were omitted from this table for brevity The PY2021 model of group T1 was a very good fit, per the Adjusted R-square in Table 4-14. Table 4-14 T1 Group Model Fit Adjusted R2 F Statistic Number of Observations Number of Weighted Treatment Customers 0.7343 66.66 147,564 4,949 Figure 4-3 displays the monthly household savings for PY2021 resulting from the linear regression, with associated confidence intervals. Impact Evaluation Results 30 Figure 4-3 T1 Group PY2021 Monthly Household Savings Before Adjustments In the winter, the household savings for the T1 group are positive; however, in the summer these savings are near zero or negative. The following table presents the home energy report savings for the T1 group by month. This was calculated using the Post*Treatment*Month (B4) and Post*Treatment (B3) terms, multiplied by the number of days in the month, and the number of weighted customers present in that month. This table also presents the double counted savings for the group, as well as the final monthly savings after removing double counted savings for each month. Impact Evaluation Results 31 Table 4-15 T1 Group PY2021 Monthly Savings Summary Month Average Treatment Impact (kWh/month) Average Incremental Double Counted Savings (kWh/month) Average Treatment Impact per Customer After Double Count (kWh/month) Control Group Usage (kWh/month) Percent Savings January 765.62 -0.05 765.67 2,633.59 29.07% February 13.37 -0.05 13.42 2,297.97 0.58% March -229.84 -0.05 -229.79 1,962.26 -11.71% April -73.43 -0.05 -73.38 1,464.96 -5.01% May -109.86 -0.05 -109.81 1,231.54 -8.92% June -326.82 -0.05 -326.77 1,479.91 -22.08% July -181.24 -0.05 -181.19 1,769.72 -10.24% August -66.1 -0.05 -66.05 1,400.93 -04.72% September -34.11 -0.05 -34.06 1,115.54 -03.06% October 5.73 -0.05 5.78 1,354.89 0.42% November -72.23 -0.05 -72.18 1,858.8 -3.89% December 552.12 -0.05 552.17 2,614.11 21.12% The ex-post gross kWh savings of Home Energy Report program for the T1 group is summarized below by program year. The number of customers used to calculate total ex-post kWh savings is the number of weighted treatment customers in the post-period. Table 4-16 T1 Group Ex-Post Annual kWh Savings Annual Unadjusted Savings Per Home (kWh/year) 5% CI Annual Unadjusted Savings Per Home (kWh/year) 95% CI Annual Unadjusted Savings Per Home (kWh/year) Annual Double Counted Savings Per Home (kWh/year) Annual Adjusted Savings Per Home (kWh/year) Annual Control Group Usage Per Home (kWh/year) Annual Percent Savings Per Home 243.31 399.73 86.9 -0.60 243.92 21,184.22 1.15% Table 4-17 T1 Group Total Program Year Savings Annual Adjusted Savings Per Home (kWh) Weighted Treatment Customers Program Year Savings (kWh) Program Year Savings (kWh) 5% CI Program Year Savings (kWh) 95% CI 243.92 4,949 1,207,146.24 1,981,248.71 433,043.78 The T1 group displayed 1.15% annual household savings for PY2021. Average annual household savings for treated customers in the T1 group was 243 kWh. Household savings estimates were extrapolated using the number of weighted treatment customers active in the post-period. The Evaluators found the T1 group to display 1,207,146 kWh in savings for the PY2021 evaluation. In addition, the 95% confidence intervals are summarized for each program year. Impact Evaluation Results 32 4.5.2 T2 Group Results This section summarizes the results of the persistence study evaluation for the T2 Group. In the table below, the coefficient estimates for Treatment*Post terms (B3) are nearly all negative, indicating lower usage per month in the post-period for treatment customers. This coefficient is statistically significant for all PY2021 months except February. The estimate for Treatment*Post*Month (B4) is mostly negative with the exception being the early summer months of May, June, and July. The Treatment*Post*Month coefficients are aggregated with the Treatment*Post coefficient, which mostly results in a negative value. This indicates positive savings for the majority of the year. Apart from September, all the Treatment*Post*Monthly coefficients are statistically significant, and once aggregated the results remain statistically significant. This indicates a positive savings effect for home energy report treatment at the 95% confidence interval. Impact Evaluation Results 33 Table 4-18 T2 Group PY2021 Regression Results Coefficient Estimate Std Error P Value 5% 95% Post -1.19 0.23 <0.001 -1.57 -0.80 February 0.24 0.28 0.396 -0.22 0.70 March -16.3 0.28 <0.001 -16.77 -15.84 April -36.15 0.28 <0.001 -36.61 -35.69 May -49.44 0.28 <0.001 -49.9 -48.97 June -47.97 0.28 <0.001 -48.43 -47.51 July -38.62 0.28 <0.001 -39.08 -38.16 August -44.26 0.28 <0.001 -44.72 -43.8 September -50.7 0.28 <0.001 -51.16 -50.23 October -40.18 0.28 <0.001 -40.64 -39.72 November -13.04 0.28 <0.001 -13.5 -12.58 December 12.21 0.28 <0.001 11.75 12.68 Treatment*Post 1.35 0.38 <0.001 0.72 1.98 Treatment*Post*February -2.45 0.43 <0.001 -3.16 -1.74 Treatment*Post*March -5.32 0.43 <0.001 -6.02 -4.61 Treatment*Post*April -0.91 0.43 0.033 -1.62 -0.21 Treatment*Post*May 1.3 0.43 0.002 0.6 2.01 Treatment*Post*June 5.69 0.43 <0.001 4.98 6.39 Treatment*Post*July 2.41 0.43 <0.001 1.71 3.12 Treatment*Post*August -1.62 0.43 <0.001 -2.32 -0.91 Treatment*Post*September -0.29 0.43 0.496 -1 0.41 Treatment*Post*October -1.53 0.43 <0.001 -2.23 -0.82 Treatment*Post*November -10.31 0.43 <0.001 -11.01 -9.61 Treatment*Post*December -13.14 0.43 <0.001 -13.84 -12.43 *Per-household fixed-effects coefficients were omitted from this table for brevity The PY2021 model of group T2 was a very good fit, per the Adjusted R-square in Table 4-19. Table 4-19 T2 Group Model Fit Adjusted R2 F Statistic Number of Observations Number of Weighted Treatment Customers 0.7605 76.58 120,324 4,320 Figure 4-4 displays the monthly household savings for PY2021 resulting from the linear regression, with associated confidence intervals. Impact Evaluation Results 34 Figure 4-4 T2 Group PY2021 Monthly Household Savings Before Adjustments Although the summer months display negative savings, the annual household savings for the T2 group is positive. The following table presents the home energy report savings for the T2 group by month. This was calculated using the Post*Treatment*Month (B4) and Post*Treatment (B3) terms, multiplied by the number of days in the month, and the number of weighted customers present in that month. This table also presents the double counted savings for the group, as well as the final monthly savings after removing double counted savings for each month. Impact Evaluation Results 35 Table 4-20 T2 Group PY2021 Monthly Savings Summary Month Average Treatment Impact (kWh/month) Average Incremental Double Counted Savings (kWh/month) Average Treatment Impact per Customer After Double Count (kWh/month) Control Group Usage (kWh/month) Percent Savings January -41.92 0.58 -42.50 2,674.56 -1.57% February 30.73 0.52 30.21 2,356.54 1.30% March 122.88 0.58 122.30 1,997.87 6.15% April -13.17 0.56 -13.73 1,460.31 -0.90% May -82.29 0.58 -82.87 1,136.85 -7.24% June -211.16 0.56 -211.72 1,274.00 -16.57% July -116.72 0.58 -117.30 1,495.06 -7.81% August 8.18 0.58 7.60 1,193.44 0.69% September -31.83 0.56 -32.39 1,002.91 -3.17% October 5.45 0.58 4.87 1,326.82 0.41% November 268.73 0.56 268.17 1,860.31 14.45% December 365.35 0.58 364.78 2,624.05 13.92% The ex-post gross kWh savings of Home Energy Report program for the T2 group is summarized below by program year. The number of customers used to calculate total ex-post kWh savings is the number of weighted treatment customers in the post-period. Table 4-21 T2 Group Ex-Post Annual kWh Savings Annual Unadjusted Savings Per Home (kWh/year) 5% CI Annual Unadjusted Savings Per Home (kWh/year) 95% CI Annual Unadjusted Savings Per Home (kWh/year) Annual Double Counted Savings Per Home (kWh/year) Annual Adjusted Savings Per Home (kWh/year) Annual Control Group Usage Per Home (kWh/year) Annual Percent Savings Per Home 304.49 483.89 125.09 6.78 297.71 20,402.72 1.46% Table 4-22 T2 Group Total Program Year Savings Annual Net Savings Per Home (kWh) Weighted Treatment Customers Program Year Savings (kWh) Program Year Savings (kWh) 5% CI Program Year Savings (kWh) 95% CI 297.71 4,320 1,286,193.89 2,061,254.98 511,132.80 The T2 group displayed 1.46% annual household savings for PY2021. Average annual household savings for treated customers in the T2 group was 298 kWh. Household savings estimates were extrapolated using the number of weighted treatment customers active in the post-period. The Evaluators found the Impact Evaluation Results 36 T2 group to display 1,286,194 kWh in savings for the PY2021 evaluation. In addition, the 95% confidence intervals are summarized for each program year. 4.5.3 T3 Group Results This section summarizes the results of the persistence study evaluation for the T3 group. In the table below, the coefficient estimates for Treatment*Post terms (B3) are mostly negative, indicating lower usage per month in the post-period for treatment customers. In addition, these coefficients were statically significant at the 95% level. The estimate for Treatment*Post*Month (B4) was positive for all months. The Treatment*Post*Month coefficients are aggregated with the Treatment*Post coefficient, which results in a negative value. This indicates positive savings for the majority of the year. Each of the Treatment*Post*Monthly coefficients are statistically significant. This indicates a positive savings effect for home energy report treatment at the 95% confidence interval. Impact Evaluation Results 37 Table 4-23 T3 PY2021 Regression Results Coefficient Estimate Std Error P Value 5% 95% Post -1.05 0.09 <0.001 -1.19 -0.90 February -6.05 0.16 <0.001 -6.31 -5.79 March -11.56 0.16 <0.001 -11.83 -11.30 April -13.11 0.16 <0.001 -13.37 -12.84 May -10.12 0.16 <0.001 -10.39 -9.86 June 2.19 0.16 <0.001 1.93 2.45 July 18.93 0.16 <0.001 18.67 19.20 August 6.37 0.16 <0.001 6.11 6.64 September -8.96 0.16 <0.001 -9.22 -8.70 October -12.63 0.16 <0.001 -12.90 -12.37 November -9.82 0.16 <0.001 -10.08 -9.55 December 0.88 0.16 <0.001 0.62 1.15 Treatment*Post -5.26 0.22 <0.001 -5.63 -4.89 Treatment*Post*February 4.81 0.29 <0.001 4.33 5.28 Treatment*Post*March 5.72 0.29 <0.001 5.25 6.20 Treatment*Post*April 5.45 0.29 <0.001 4.98 5.92 Treatment*Post*May 4.03 0.29 <0.001 3.56 4.51 Treatment*Post*June 12.34 0.29 <0.001 11.87 12.81 Treatment*Post*July 5.18 0.29 <0.001 4.71 5.66 Treatment*Post*August 2.85 0.29 <0.001 2.38 3.33 Treatment*Post*September 5.19 0.29 <0.001 4.72 5.66 Treatment*Post*October 3.92 0.29 <0.001 3.44 4.39 Treatment*Post*November 4.41 0.29 <0.001 3.94 4.88 Treatment*Post*December 0.8 0.29 0.005 0.33 1.27 *Per-household fixed-effects coefficients were omitted from this table for brevity The PY2021 model of group T3 was a good fit, per the Adjusted R-square in Table 4-24. Table 4-24 T3 Group Model Fit Adjusted R2 F Statistic Number of Observations Number of Weighted Treatment Customers 0.6776 51.24 192,438 5,024 Figure 4-5 displays the monthly household savings for PY2021 resulting from the linear regression, with associated confidence intervals. Impact Evaluation Results 38 Figure 4-5 T3 Group PY2021 Monthly Household Savings Before Adjustments Although there were substantially negative savings in June and slightly negative ones in March and April, the annual household savings for the T3 group is positive. The following table presents the home energy report savings for the T3 group by month. This was calculated using the Post*Treatment*Month (B4) and Post*Treatment (B3) terms, multiplied by the number of days in the month, and the number of weighted customers present in that month. This table also presents the double counted savings for the group, as well as the final monthly savings after removing double counted savings for each month. Impact Evaluation Results 39 Table 4-25 T3 Group PY2021 Monthly Savings Summary Month Average Treatment Impact (kWh/month) Average Incremental Double Counted Savings (kWh/month) Average Treatment Impact per Customer After Double Count (kWh/month) Control Group Usage (kWh/month) Percent Savings January 163.02 0.13 162.89 1,286.79 12.67% February 12.70 0.12 12.59 1,126.40 1.13% March -14.45 0.13 -14.58 1,098.81 -1.32% April -5.83 0.12 -5.95 1,003.13 -0.58% May 37.97 0.13 37.84 1,085.42 3.50% June -212.46 0.12 -212.58 1,666.18 -12.75% July 2.29 0.13 2.16 2,020.32 0.11% August 74.53 0.13 74.41 1,555.50 4.79% September 2.06 0.12 1.93 1,119.78 0.18% October 41.64 0.13 41.51 1,013.25 4.11% November 25.40 0.12 25.28 1,085.71 2.34% December 138.21 0.13 138.08 1,347.97 10.25% The ex-post gross kWh savings of Home Energy Report program for the T3 group is summarized below by program year. The number of customers used to calculate total ex-post kWh savings is the number of weighted treatment customers in the post-period. Table 4-26 T3 Group Ex-Post Annual kWh Savings Annual Unadjusted Savings Per Home (kWh/year) 5% CI Annual Unadjusted Savings Per Home (kWh/year) 95% CI Annual Unadjusted Savings Per Home (kWh/year) Annual Double Counted Savings Per Home (kWh/year) Annual Adjusted Savings Per Home (kWh/year) Annual Control Group Usage Per Home (kWh/year) Annual Percent Savings Per Home 265.19 345.62 184.76 1.50 263.69 15,409.27 1.71% Table 4-27 T3 Group Total Program Year Savings Annual Net Savings Per Home (kWh) Weighted Treatment Customers Program Year Savings (kWh) Program Year Savings (kWh) 5% CI Program Year Savings (kWh) 95% CI 263.69 5,024 1,324,881.76 1,728,990.32 920,773.21 The T3 group displayed 1.71% annual household savings for PY2021. Average annual household savings for treated customers in the T3 was 264 kWh. Household savings estimates were extrapolated using the number of weighted treatment customers active in the post-period. The Evaluators found the T3 group Impact Evaluation Results 40 to display 1,324,882 kWh in savings for the PY2021 evaluation period. In addition, the 95% confidence intervals are summarized for each program year. 4.5.4 T4 Group Results This section summarizes the results of the persistence study evaluation for the T4 Group. In the table below, the coefficient estimates for Treatment*Post terms (B3) are mostly negative, indicating lower usage per month in the post-period for treatment customers. In addition, these coefficients are statically significant at the 95% level. The estimate for Treatment*Post*Month (B4) is positive for all months in 2021. The Treatment*Post*Month coefficients are aggregated with the Treatment*Post coefficient, which results in a negative value and consequent positive savings. Each of the Treatment*Post*Monthly coefficients are statistically significant which indicates a statistically significant positive savings effect for home energy report treatment at the 95% confidence interval. Impact Evaluation Results 41 Table 4-28 T4 Group PY2021 Regression Results Coefficient Estimate Std Error P Value 5% 95% Post 0.63 0.08 <0.001 0.50 0.76 February -4.16 0.16 <0.001 -4.42 -3.9 March -7.88 0.16 <0.001 -8.14 -7.63 April -9.14 0.16 <0.001 -9.39 -8.88 May -7.55 0.16 <0.001 -7.81 -7.29 June 2.81 0.16 <0.001 2.55 3.07 July 16.91 0.16 <0.001 16.65 17.17 August 5.19 0.16 <0.001 4.93 5.45 September -6.88 0.16 <0.001 -7.14 -6.63 October -9.01 0.16 <0.001 -9.27 -8.75 November -6.67 0.16 <0.001 -6.93 -6.41 December 0.44 0.16 0.005 0.19 0.70 Treatment*Post -3.54 0.24 <0.001 -3.93 -3.15 Treatment*Post*February 3.24 0.31 <0.001 2.73 3.75 Treatment*Post*March 3.51 0.31 <0.001 3.01 4.02 Treatment*Post*April 2.98 0.31 <0.001 2.47 3.49 Treatment*Post*May 2.05 0.31 <0.001 1.54 2.56 Treatment*Post*June 8.38 0.31 <0.001 7.87 8.89 Treatment*Post*July 2.65 0.31 <0.001 2.14 3.16 Treatment*Post*August 1.71 0.31 <0.001 1.20 2.22 Treatment*Post*September 3.3 0.31 <0.001 2.79 3.81 Treatment*Post*October 2.64 0.31 <0.001 2.13 3.15 Treatment*Post*November 2.85 0.31 <0.001 2.34 3.35 Treatment*Post*December 0.69 0.31 0.025 0.18 1.20 *Per-household fixed-effects coefficients were omitted from this table for brevity The PY2021 model of group T4 was a good fit, per the Adjusted R-square in Table 4-29. Table 4-29 T4 Group Model Fit Adjusted R2 F Statistic Number of Observations Number of Weighted Treatment Customers 0.5804 34.02 109,651 2,356 Figure 4-6 displays the monthly household savings for PY2021 resulting from the linear regression, with associated confidence intervals. Impact Evaluation Results 42 Figure 4-6 T4 Group PY2021 Monthly Household Savings Before Adjustments Although June displays clear negative savings, the annual household savings for the T4 group is positive due to large savings in all other months. The following table presents the home energy report savings for the T4 group by month. This was calculated using the Post*Treatment*Month (B4) and Post*Treatment (B3) terms, multiplied by the number of days in the month, and the number of weighted customers present in that month. This table also presents the double counted savings for the group, as well as the final monthly savings after removing double counted savings for each month. Impact Evaluation Results 43 Table 4-30 T4 Group PY2021 Monthly Savings Summary Month Average Treatment Impact (kWh/day) Average Incremental Double Counted Savings (kWh/month) Average Treatment Impact per Customer After Double Count (kWh/month) Control Group Usage (kWh/day) Percent Savings January 109.63 0.08 109.55 904.49 12.12% February 8.28 0.08 8.20 785.78 1.05% March 0.72 0.08 0.63 762.22 0.09% April 16.70 0.08 16.62 689.04 2.42% May 46.10 0.08 46.02 741.28 6.22% June -145.31 0.08 -145.40 1,231.8 -11.80% July 27.43 0.08 27.35 1,539.91 1.78% August 56.57 0.08 56.48 1,137.32 4.97% September 7.18 0.08 7.09 780.98 0.92% October 27.71 0.08 27.63 706.77 3.92% November 20.73 0.08 20.65 766.39 2.70% December 88.17 0.08 88.08 941.88 9.36% The ex-post gross kWh savings of Home Energy Report program for the T4 group is summarized below by program year. The number of customers used to calculate total ex-post kWh savings is the number of weighted treatment customers in the post-period. Table 4-31 T4 Group Ex-Post Annual kWh Savings by Program Year Annual Unadjusted Savings Per Home (kWh/year) 5% CI Annual Unadjusted Savings Per Home (kWh/year) 95% CI Annual Unadjusted Savings Per Home (kWh/year) Annual Double Counted Savings Per Home (kWh/year) Annual Adjusted Savings Per Home (kWh/year) Annual Control Group Usage Per Home (kWh/year) Annual Percent Savings Per Home 263.98 342.98 184.97 0.99 262.99 10,987.86 2.39% Table 4-32 T4 Group Total Program Year Savings by Evaluation Period Annual Net Savings Per Home (kWh) Weighted Treatment Customers Program Year Savings (kWh) Program Year Savings (kWh) 5% CI Program Year Savings (kWh) 95% CI 262.99 2,356 619,578.90 805,709.18 433,448.62 The T4 group displayed 2.39% annual household savings for PY2021. Average annual household savings for treated customers in the T4 group was 263 kWh. Household savings estimates were extrapolated using the number of weighted treatment customers active in the post-period. The Evaluators found the Impact Evaluation Results 44 T4 group to display 619,579 kWh in savings for the PY2021 evaluation period. In addition, the 95% confidence intervals are summarized for each program year. 4.5.5 T5 Group Results This section summarizes the results of the persistence study evaluation for the T5 Group. In the table below, the coefficient estimate for Treatment*Post terms (B3) is negative for most months, indicating lower usage per month in the post-period for treatment customers. The exceptions to this are the summer months June, July, and August, as well as December. The estimates for Treatment*Post*Month (B4) are all positive. The Treatment*Post*Month coefficients are aggregated with the Treatment*Post coefficient, which results in a negative value. Treatment*Post*Monthly coefficients were statistically significant for all months except December. However, the results remain statistically significant once aggregated. This indicates a statistically significant and positive savings effect for home energy report treatment at the 95% confidence interval. Impact Evaluation Results 45 Table 4-33 T5 Group PY2021 Regression Results Coefficient Estimate Std Error P Value 5% 95% Post 3.3 0.09 <0.001 3.15 3.45 February -2.94 0.18 <0.001 -3.24 -2.64 March -5.9 0.18 <0.001 -6.2 -5.6 April -6.84 0.18 <0.001 -7.14 -6.54 May -5.57 0.18 <0.001 -5.87 -5.27 June 3.69 0.18 <0.001 3.39 3.99 July 16.47 0.18 <0.001 16.17 16.77 August 4.78 0.18 <0.001 4.48 5.07 September -5.5 0.18 <0.001 -5.79 -5.2 October -7.05 0.18 <0.001 -7.35 -6.75 November -5.11 0.18 <0.001 -5.4 -4.81 December 0.52 0.18 0.004 0.22 0.81 Treatment*Post -3.66 0.27 <0.001 -4.11 -3.21 Treatment*Post*February 2.1 0.36 <0.001 1.51 2.69 Treatment*Post*March 2.24 0.36 <0.001 1.65 2.83 Treatment*Post*April 2.05 0.36 <0.001 1.46 2.64 Treatment*Post*May 1.51 0.36 <0.001 0.92 2.1 Treatment*Post*June 7.23 0.36 <0.001 6.64 7.83 Treatment*Post*July 2.19 0.36 <0.001 1.6 2.78 Treatment*Post*August 2.04 0.36 <0.001 1.45 2.63 Treatment*Post*September 3.06 0.36 <0.001 2.47 3.65 Treatment*Post*October 2.15 0.36 <0.001 1.56 2.74 Treatment*Post*November 2.2 0.36 <0.001 1.61 2.79 Treatment*Post*December 0.53 0.36 0.14 -0.06 1.12 *Per-household fixed-effects coefficients were omitted from this table for brevity The PY2021 model of group T5 was a good fit, per the Adjusted R-square in Table 4-34. Table 4-34 T5 Group Model Fit Adjusted R2 F Statistic Number of Observations Number of Weighted Treatment Customers 0.5490 29.98 77,548 1,646 Figure 4-7 displays the monthly household savings for PY2021 resulting from the linear regression, with associated confidence intervals. Impact Evaluation Results 46 Figure 4-7 T5 Group PY2021 Monthly Household Savings Before Adjustments All months except June display positive savings. Therefore, the annual household savings for the T5 group is positive. The following table presents the home energy report savings for the T5 group by month. This was calculated using the Post*Treatment*Month (B4) and Post*Treatment (B3) terms, multiplied by the number of days in the month, and the number of weighted customers present in that month. This table also presents the double counted savings for the group, as well as the final monthly savings after removing double counted savings for each month. Impact Evaluation Results 47 Table 4-35 T5 Group PY2021 Monthly Savings Summary Month Average Treatment Impact (kWh/day) Average Incremental Double Counted Savings (kWh/month) Average Treatment Impact per Customer After Double Count (kWh/month) Control Group Usage (kWh/day) Percent Savings January 113.42 -0.03 113.45 807.45 14.05% February 43.61 -0.03 43.64 706.77 6.17% March 43.95 -0.03 43.98 680.50 6.46% April 48.34 -0.03 48.37 613.34 7.88% May 66.64 -0.03 66.67 659.47 10.10% June -107.27 -0.03 -107.24 1,104.30 -9.71% July 45.50 -0.03 45.53 1,387.71 3.28% August 50.08 -0.03 50.11 1,009.16 4.96% September 18.00 -0.03 18.04 686.14 2.62% October 46.72 -0.03 46.75 626.65 7.46% November 43.86 -0.03 43.89 679.94 6.45% December 96.95 -0.03 96.99 847.13 11.45% The ex-post gross kWh savings of Home Energy Report program for the T5 group is summarized below by program year. The number of customers used to calculate total ex-post kWh savings is the number of weighted treatment customers in the post-period. Table 4-36 T5 Group Ex-Post Annual kWh Savings Annual Unadjusted Savings Per Home (kWh/year) 5% CI Annual Unadjusted Savings Per Home (kWh/year) 95% CI Annual Unadjusted Savings Per Home (kWh/year) Annual Double Counted Savings Per Home (kWh/year) Annual Adjusted Savings Per Home (kWh/year) Annual Control Group Usage Per Home (kWh/year) Annual Percent Savings Per Home 510.2 601.8 418.6 -0.38 510.58 9,808.57 5.21% Table 4-37 T5 Group Total Program Year Savings Annual Net Savings Per Home (kWh) Weighted Treatment Customers Program Year Savings (kWh) Program Year Savings (kWh) 5% CI Program Year Savings (kWh) 95% CI 510.58 1,646 840,396.58 991,167.48 689,625.69 The T5 group displayed 5.21% annual household savings for PY2021. Average annual household savings for treated customers in the T5 group was 511 kWh. Household savings estimates were extrapolated using the number of weighted treatment customers active in the post-period. The Evaluators found the Impact Evaluation Results 48 T5 group to display 840,397 kWh in savings for the PY2021 evaluation period. In addition, the 95% confidence intervals are summarized for each program year. 4.5.6 T6 Group Results This section summarizes the results of the persistence study evaluation for the T6 Group. In the table below, the coefficient estimate for Treatment*Post terms (B3) is negative for all months except July, August, and December. All coefficients are statistically significant, indicating lower usage per month in the post-period for treatment customers. The estimate for Treatment*Post*Month (B4) is positive for all months except for June and July. The Treatment*Post*Month coefficients are aggregated with the Treatment*Post coefficient, which results in a negative value for nearly all months. This indicates positive savings for the majority of the year. Each of the Treatment*Post*Monthly coefficients are statistically significant. Overall, the results remain statistically significant once aggregated. This indicates a statistically significant and positive savings effect for home energy report treatment at the 95% confidence interval. Impact Evaluation Results 49 Table 4-38 T6 Group PY2021 Regression Results Coefficient Estimate Std Error P Value 5% 95% Post 1.40 0.05 <0.001 1.32 1.48 February -1.06 0.06 <0.001 -1.15 -0.96 March -7.50 0.06 <0.001 -7.59 -7.40 April -10.21 0.06 <0.001 -10.30 -10.11 May -10.20 0.06 <0.001 -10.29 -10.10 June -5.57 0.06 <0.001 -5.66 -5.47 July 4.32 0.06 <0.001 4.22 4.41 August 2.75 0.06 <0.001 2.66 2.85 September -9.43 0.06 <0.001 -9.53 -9.34 October -9.55 0.06 <0.001 -9.64 -9.45 November -4.38 0.06 <0.001 -4.48 -4.29 December 2.41 0.06 <0.001 2.32 2.51 Treatment*Post 0.28 0.08 <0.001 0.15 0.42 Treatment*Post*February -0.38 0.09 <0.001 -0.52 -0.24 Treatment*Post*March -1.06 0.09 <0.001 -1.20 -0.91 Treatment*Post*April -2.68 0.09 <0.001 -2.83 -2.54 Treatment*Post*May -3.47 0.09 <0.001 -3.61 -3.33 Treatment*Post*June 8.86 0.09 <0.001 8.71 9.00 Treatment*Post*July 7.73 0.09 <0.001 7.58 7.87 Treatment*Post*August -4.11 0.09 <0.001 -4.26 -3.97 Treatment*Post*September -2.88 0.09 <0.001 -3.02 -2.73 Treatment*Post*October -4.72 0.09 <0.001 -4.87 -4.58 Treatment*Post*November -4.00 0.09 <0.001 -4.15 -3.86 Treatment*Post*December -1.40 0.09 <0.001 -1.54 -1.26 *Per-household fixed-effects coefficients were omitted from this table for brevity The PY2021 model of group T6 was a good fit, per the Adjusted R-square in Table 4-39. Table 4-39 T6 Group Model Fit Adjusted R2 F Statistic Number of Observations Number of Weighted Treatment Customers 0.6329 42.34 2,421,711 88,827 Figure 4-8 displays the monthly household savings for PY2021 resulting from the linear regression, with associated confidence intervals. Impact Evaluation Results 50 Figure 4-8 T6 PY2021 Monthly Household Savings Before Adjustments Although January and early summer months display negative savings, the annual household savings for the T6 group is positive. The following table presents the home energy report savings for the T6 group by month. This was calculated using the Post*Treatment*Month (B4) and Post*Treatment (B3) terms, multiplied by the number of days in the month, and the number of weighted customers present in that month. This table also presents the double counted savings for the group, as well as the final monthly savings after removing double counted savings for each month. Impact Evaluation Results 51 Table 4-40 T6 Group PY2021 Monthly Savings Summary Month Average Treatment Impact (kWh/day) Average Incremental Double Counted Savings (kWh/month) Average Treatment Impact per Customer After Double Count (kWh/month) Control Group Usage (kWh/day) Percent Savings January -8.82 -0.11 -8.71 1,405.92 -0.63% February 2.63 -0.10 2.73 1,231.36 0.21% March 23.93 -0.11 24.04 1,144.14 2.09% April 72.01 -0.11 72.11 979.31 7.35% May 98.72 -0.11 98.84 986.24 10.01% June -274.21 -0.11 -274.11 1,466.97 -18.69% July -248.3 -0.11 -248.19 1,785.83 -13.90% August 118.72 -0.11 118.83 1,370.14 8.66% September 77.74 -0.11 77.85 998.25 7.79% October 137.61 -0.11 137.73 967.14 14.23% November 111.57 -0.11 111.68 1,116.75 9.99% December 34.63 -0.11 34.74 1,441.99 2.40% The ex-post gross kWh savings of Home Energy Report program for the T6 group is summarized below by program year. The number of customers used to calculate total ex-post kWh savings is the number of weighted treatment customers in the post-period. Table 4-41 T6 Group Ex-Post Annual kWh Savings by Program Year Annual Unadjusted Savings Per Home (kWh/year) 5% CI Annual Unadjusted Savings Per Home (kWh/year) 95% CI Annual Unadjusted Savings Per Home (kWh/year) Annual Double Counted Savings Per Home (kWh/year) Annual Adjusted Savings Per Home (kWh/year) Annual Control Group Usage Per Home (kWh/year) Annual Percent Savings Per Home 146.25 185.16 107.34 -1.32 147.57 14,894.04 0.99% Table 4-42 T6 Group Total Program Year Savings by Evaluation Period Annual Net Savings Per Home (kWh) Weighted Treatment Customers Program Year Savings (kWh) Program Year Savings (kWh) 5% CI Program Year Savings (kWh) 95% CI 147.57 88,827 13,108,083.44 16,564,309.12 9,651,857.76 The T6 group displayed 0.99% annual household savings for PY2021. Average annual household savings for treated customers in the T6 group was 148 kWh. Household savings estimates were extrapolated using the number of weighted treatment customers active in the post-period. The Evaluators found the Impact Evaluation Results 52 T6 group to display 13,108,083 kWh in savings for the PY2021 evaluation period. In addition, the 95% confidence intervals are summarized for each program year. 4.5.7 Aggregated Groups Results The Evaluators present positive, statistically significant savings for all groups evaluated. The Evaluators adjusted regression results with double counted savings in downstream programs to arrive at the final program savings estimate. The following tables summarize each group’s annual household energy savings impact with 95% confidence intervals. Table 4-43 PY2021 Program Savings Summary Group Weighted Customers Annual Household Savings (kWh) Annual Household 5% CI (kWh) Annual Household 95% CI (kWh) Program Savings (kWh) Program Savings 5% CI (kWh) Program Savings 95% CI (kWh) T1 4,949 243.92 400.33 87.50 1,207,146 1,981,249 433,044 T2 4,320 297.71 477.12 118.31 1,286,194 2,061,255 511,133 T3 5,024 263.69 344.12 183.26 1,324,882 1,728,990 920,773 T4 2,356 262.99 341.99 183.98 619,579 805,709 433,449 T5 1,646 510.58 602.18 418.98 840,397 991,167 689,626 T6 88,827 147.57 186.48 108.66 13,108,083 16,564,309 9,651,858 Total 107,122 171.64 225.28 118.00 18,386,281 24,132,679 12,639,883 4.6 Demand Reductions The Evaluators estimated the demand reductions using the kWh savings estimated from the linear regression results after adjustments for double counted savings. The Evaluators estimated demand reduction by dividing the annual energy savings by integrating hourly load factors with monthly estimated energy savings for each group for both the annual program year and the extended program year. The following figures display average residential load by end use from the Energy Open Data Catalog database4. 4 Using TMY3 data from the Boise International Airport weather station Impact Evaluation Results 53 Figure 4-9 Typical Annual Load Profile Figure 4-10 Typical Daily Load Profile The Evaluators conducted the steps presented in the demand calculation methodology in Section 3.7. The following table displays the resulting demand reductions for each group and the total demand reductions for 2021 program year. Impact Evaluation Results 54 Table 4-44 Demand Reductions by Group Group Verified Demand Savings (kW) T1 149.32 T2 159.09 T3 163.97 T4 76.68 T5 104.01 T6 1,622.13 Total 2,275.19 In summary, the 2021 program year for the Home Energy Report Program is estimated to save 2,275.19 kW. 4.7 Attrition Analysis Results The Evaluators estimated the cumulative level of both treatment and control move outs over the program life by month, group, and treatment/control status for each program year. The following table displays the total reallocation (i.e., moveout and group re-assignment) rate aggregating all groups. Overall attrition in 2021 was approximately 7.5% and 0.9% for treatment and control customers, respectively. Impact Evaluation Results 55 Table 4-45 Program Reallocation Rates by Program Year Period Treatment Customers Control Customers Treatment Reallocation Percent Control Reallocation Percent 2021 10,550 1,838 7.47% 0.88% The moveout rates for each group and treatment group range between 0.0% and 8.7%. The low rates of attrition in T5 are likely due to the fact that despite earlier moveouts of nearly all control and treatment customers, the Evaluators still included this group in the analysis. Given that the T6 group was initiated in June 2020, it is possible that the high moveout rates can be explained by a combination of pandemic-related moves and group stabilization over the first full year of the program. That is, the T6 treatment and control groups consist of customers with household behaviors different than those of T1 through T5. The attrition rate indicates that the customers in T6 either have a naturally high attrition rate, or responded to the COVID-19 pandemic with a higher rate of moveouts than other groups. Table 4-46 PY2021 Moveout Rates by Group Group Treatment Customers Control Customers Treatment Moveout Customers Control Moveout Customers Treatment Moveout Percent Control Moveout Percent T1 7,900 16,558 363 102 4.59% 0.62% T2 5,826 5,826 350 47 6.01% 0.81% T3 8,501 49,727 399 249 4.69% 0.50% T4 4,101 46,191 190 156 4.63% 0.34% T5 6,501 75,801 134 0 2.06% 0.00% T6 108,498 14,744 9,114 1,284 8.40% 8.71% The following figures summarize the cumulative moveout rates by month for each group and each treatment group in 2021. Impact Evaluation Results 56 Figure 4-11 PY2021 Monthly Moveout Rates by Group 4.8 Additional Research The Evaluators conducted additional research for the following IPC objectives: ◼ T5 year-after-year savings ◼ Validation of rate schedule optimization ◼ Validation of benchmarking flags The following sections detail the methodology and results of each of the research objectives listed above. 4.8.1 T5 Year-After-Year Savings The T5 group was added to the Home Energy Report Pilot in year 1 and was designed to represent customers with low year-round energy use. As previously detailed, IPC stopped sending reports to the T5 group in April 2020 due to low propensity for savings. This decision was made in order to increase the cost-effectiveness of the program. IPC is interested to determine whether this group displays observable persistence savings (energy savings despite lack of treatment) and whether the decision to remove the T5 group was appropriate. The T5 group started treatment in August 2017 and ended treatment in April 2020. The Evaluators estimated observed savings for this group using the same methodology presented for T1, T2, T3, T4, and T5, also presented in Section 3. The Evaluators estimated unadjusted kWh savings for each post-period year: 2018, 2019, 2020, and 2021. These estimates do not account for removal of double counted Impact Evaluation Results 57 savings; however, these values provide context for incremental observed savings year-after-year for this group of customers. The results are as follows: Table 4-47 T5 Year-After-Year Savings Evaluated Year Statistically Significant Savings Annual kWh Savings per Household (Unadjusted) Annual % Savings 2018 ✓ 208.77 2.13% 2019 ✓ 264.96 2.70% 2020 ✓ 408.81 4.17% 2021 ✓ 510.20 5.20% As the table above illustrates, the T5 group indicated increasing savings over time, with Home Energy Report treatment contributing to 208.77 kWh or 2.13% annual household savings in the group’s first post-period year in 2018 with a steady upward savings trend to 510.20 kWh or 5.20% annual household savings in 2021. The T5 group continues to contribute statistically significant energy savings meeting or exceeding behavioral program expectations of 1-3% annual household savings. Although the T5 group contributes 1.5% towards participation in the Home Energy Report Program, the group continues to contribute disproportionately high energy savings towards the program at over 4.5% program savings contribution. Table 4-48 T5 Contribution to 2021 Program Savings Group Weighted Customers Contribution to Participation Program Savings Contribution to Program Savings T1 4,949 4.62% 1,207,146 6.57% T2 4,320 4.03% 1,286,194 7.00% T3 5,024 4.69% 1,324,882 7.21% T4 2,356 2.20% 619,579 3.37% T5 1,646 1.54% 840,397 4.57% T6 88,827 82.92% 13,108,083 71.29% The results of this analysis indicate that the IPC customers with low year-round energy use may behave differently than the other groups in the program. Annual household energy savings for this group nearly doubled between 2019 and 2020. The COVID-19 pandemic shelter-in-place orders may have heavily impacted this group of customers’ behaviors towards energy consumption. Customers with low year- round energy use may consist of a greater proportion of low-income customers. In the case that these customers prioritized keeping costs low during the shelter-in-place orders, these customers seem to have greatly benefitted from the energy saving tips communicated through the Home Energy Reports. Impact Evaluation Results 58 Based on these results, the Evaluators conducted additional efforts to explore year-after-year savings for the remaining groups as well. The T1, T2, T3, T4, and T5 groups have each responded differently to treatment over time, illustrated in the figures below. Figure 4-12 T1 Year-After-Year Savings Figure 4-13 T2 Year-After-Year Savings Impact Evaluation Results 59 Figure 4-14 T3 Year-After-Year Savings Figure 4-15 T4 Year-After-Year Savings Impact Evaluation Results 60 Figure 4-16 T5 Year-After-Year Savings Figure 4-17 T6 Year-After-Year Savings Each of the other groups seem to display a plateaued energy savings value, year-after-year, with the exception of T4 and T5. These two groups display an increasing trend towards increased energy savings, year-after-year. T4 consists of customers with medium year-round energy use, and T5 consists of customers with low year-round energy use. This research illustrates that, although there is reason to believe that low energy users have lower propensity to save energy through Home Energy Reports, these customers consistently display higher than expected savings during times when financial burden is Impact Evaluation Results 61 high. The Evaluators therefore recommend that IPC continue treating customers with low to medium annual energy use. 4.8.2 Rate Schedule Optimization In 2020, IPC made the decision to stop sending reports to customers who had transitioned from the residential rate schedule (I01) to the customer generation rate schedule (I06). These customers were retained in each group, but no longer receive Home Energy Reports. IPC is interested to know if there is a difference in savings magnitude between the groups when these customer generation rate schedule customers are included in the analysis, and when these customers are not included in the analysis. The Evaluators found that when the customer generation customers were removed from each of the groups, the groups no longer remained statistically valid between treatment and control groups. This means that, although the IPC customers in each were randomly assigned to each the treatment and control group, the proportion of customers who had transitioned to the customer generation rate schedule between the treatment and control group is not equal. The table below illustrates the proportion of customers who had transitioned to customer generation rate schedules in each group and treatment group. Table 4-49 Customer Generation Conversion by Group Group Treatment Control T1 0.75% 3.65% T2 0.50% 2.58% T3 0.98% 5.00% T4 0.85% 4.12% T5 1.15% 2.05% T6 0.81% 1.47% For groups T1 through T4, the control customers contributed to five times more customer generation rate schedule conversions than the treatment customers. For groups T5 and T6, the control customers contributed two times more customer generation rate schedule conversions than the treatment customers. The treatment group may display less likelihood of converting to customer generation rate schedule due to the information provided on the neighbor comparison Home Energy Reports. The Home Energy Reports provide customer household information and compares the customers’ energy usage to neighboring homes. If a customer is informed that their energy usage habits are relatively more efficient than their neighbors, these customers may be less inclined to take additional large financial home improvement projects, such as installing solar and switching to customer generation rate schedules. Due to these findings, the Evaluators are unable to provide incremental household savings estimates with and without the customer generation rate schedule conversion customers. The Evaluators recommend that IPC continue to include these customers in the T1 through T6 groups and refrain from Impact Evaluation Results 62 reallocating them to another treatment group. This will ensure that all legacy groups remain statistically valid and evaluable. 4.8.3 Benchmarking Flags The Evaluators explored the benchmarking flags aggregated and used by the implementer for use in the Home Energy Report messaging. The benchmarking flags are currently required by the implementers to generate reports. Therefore, in the case that a home does not have valid benchmarking flags, the customer is ineligible for participation in the program in both the treatment and control group. The implementers document the following benchmarks for each household in the table below. Table 4-50 Benchmarking Flags Summary Item Description SDPID Service Point Identifier (Device Location ID) County Physical address county location HasAC AC Flag (-1 = No data, 0 = No AC, 1 = Has AC) HasEHW Electrically heated water Flag (-1 = No data, 0 = No electric water heating, 1 = Has electric water heating) HasESH Electric space heating flag (-1 = No data, 0 = No electric space heating, 1 = Has electric space heating) HasGSH Gas space heating flag (-1 = No data, 0 = No gas space heating, 1 = Has gas space heating) HasNG Natural gas flag (-1 = No data, 0 = No natural gas service, 1 = Has natural gas service) HasPool Pool flag (-1 = No data, 0 = No pool, 1 = Has pool) Rate_Cat_Cd Rate Category (I01 = Residential Service, I06 = Residential on-site generation, I05 = Residential time of day) PhyAddrZip Zip code of physical home address Home_Bdrm_Cnt Bedroom Count Home_Year_Built Home year built HomeType Home type (-1 = No data, SFD = single family, Mobile = manufactured and mobile homes, Mplex = Multiplex, Condo = condo, MultiFamily Undifferentiated = multifamily, but less detail (for example, condo, multiplex, townhome, apartments) Sqft Home square footage IPC provided the housing characteristics for all customers in the Home Energy Report Program. The Evaluators explored the number of households with missing benchmarking data. The results are provided in the figure below. Impact Evaluation Results 63 Figure 4-18 Proportion of Households with Missing Benchmarks The Evaluators found that nearly 100% of the households had no data for HasEHW, HasGSH, and HasPool. However, the proportion of missing data within each the treatment and control groups were nearly equivalent in each category. Additionally, the proportion remains consistent when inspecting treatment and control groups within each group. Because nearly all of IPC’s residential customer base is currently designated to either a treatment or control group, the lack of household characteristics in this benchmarking dataset provide no barriers for participation in the program. The Evaluators understand that the addition of these benchmarking flags, especially the air conditioning and electric heating flags, have previously resulted in removal of a subset of customers in each treatment group group, until additional data was acquired (T2). The Evaluators have found that imperfect messaging to a larger population results in higher savings rather than what is achieved with more accurate messaging to the subset of the population which has better data available. Therefore, The Evaluators recommend that if a group is designed for the program in the future, that the lack of benchmarking characteristics is not used as a prerequisite for participation. Impact & Process Evaluation of Idaho Power Company PY202 1 Commercial Energy -Saving Kit s Program ADM Associates, Inc 3239 Ramos Circle Sacramento, CA 95827 916-363-8383 Idaho Power Company 1221 West Idaho St. Boise, ID 83702 208-388-2200 SUBMITTED TO: IDAHO POWER COMPANY SUBMITTED ON: JANUARY 19, 2023 SUBMITTED BY: ADM ASSOCIATES, INC. Tables of Contents and Tables ii Table of Contents 1. Executive Summary .............................................................................................................................. 5 1.1 Savings Results............................................................................................................................................ 5 1.2 Conclusions & Recommendations .............................................................................................................. 6 2. General Methodology ........................................................................................................................ 10 2.1 Glossary of Terminology ........................................................................................................................... 11 2.2 Summary of Approach .............................................................................................................................. 12 3. Impact Evaluation Results .................................................................................................................. 20 3.1 Simple Verification Results ....................................................................................................................... 22 3.2 Non-Energy Benefits and Non-Energy Impacts ........................................................................................ 23 3.3 Measure-Level Impact Evaluation Results ................................................................................................ 23 3.4 Potential Unified Kit Results ..................................................................................................................... 33 4. Process Evaluation Results ................................................................................................................. 35 4.1 Program Design and Operations............................................................................................................... 35 4.2 Commercial Savings Kit Customer Survey Results .................................................................................... 36 5. Appendix A: Participant Survey .......................................................................................................... 42 5.1 Pre-Defined Variables ............................................................................................................................... 42 5.2 Email Survey Message .............................................................................................................................. 42 5.3 Survey ....................................................................................................................................................... 43 admenergy.com | 3239 Ramos Circle, Sacramento, CA 95827| 916.363.8383 iii List of Tables Table 1-1: Commercial Energy-Saving Kits Verified Impact Savings by Facility Type ................................... 5 Table 1-2: Commercial Energy-Saving Kits Verified Impact Savings by Measure and Facility Type ............. 5 Table 2-1: Survey-based Verification Completion and Precision by Facility Type ...................................... 14 Table 2-2: Virtual Verification Summary ..................................................................................................... 15 Table 2-3: Virtual Verification Completions and Precision by Facility Type ............................................... 15 Table 2-4: Impact Analysis Methodology by Measure ................................................................................ 16 Table 2-5: Summary of Survey Data Collection .......................................................................................... 19 Table 2-6: Distribution of Measures Installed at Participating Sites and Installed by Survey Respondents ............................................................................................................................................................ 19 Table 3-1: Kit Contents Summary ............................................................................................................... 20 Table 3-2: Commercial Energy-Saving Kits Program Verified Impact Savings by Measure ........................ 20 Table 3-3: Commercial Energy-Saving Kits Program Verified Impact Savings by Measure and Facility Type ............................................................................................................................................................ 21 Table 3-4: Commercial Energy-Saving Kits Delivered in PY2021 ................................................................ 22 Table 3-5: Simple Verification Survey Response Rate ................................................................................ 22 Table 3-6: Verified In-Service Rates by Measure and Facility Type ............................................................ 22 Table 3-7: Assumed In-Service Rates by Measure and Facility Type .......................................................... 23 Table 3-8: Total Verified NEBs and NEIs ..................................................................................................... 23 Table 3-9: Lighting Measure Description .................................................................................................... 24 Table 3-10: Lighting Measure Population Verified Savings ........................................................................ 24 Table 3-11: Lighting Measure Verification Survey ISR Results .................................................................... 25 Table 3-12: Office Kit Adjusted Lighting Savings ......................................................................................... 25 Table 3-13: Restaurant Kit Adjusted Lighting Savings ................................................................................. 26 Table 3-14: Retail Kit Adjusted Lighting Savings ......................................................................................... 26 Table 3-15: Office Kit Lighting NEBs and NEIs ............................................................................................. 27 Table 3-16: Restaurant Kit Lighting NEBs and NEIs ..................................................................................... 27 Table 3-17: Retail Kit Lighting NEBs and NEIs ............................................................................................. 27 Table 3-18 Total Lighting Measure NEBs and NEIs Across Kits ................................................................... 27 Table 3-19: Hot Water Measure Description .............................................................................................. 28 admenergy.com | 3239 Ramos Circle, Sacramento, CA 95827| 916.363.8383 iv Table 3-20: Hot Water Measures Verified Electric Savings ........................................................................ 28 Table 3-21: Hot Water Measures Verification Survey ISR Results .............................................................. 28 Table 3-22: Office Kit Adjusted Hot Water Savings .................................................................................... 29 Table 3-23: Restaurant Kit Adjusted Hot Water Savings ............................................................................ 29 Table 3-24: Retail Kit Adjusted Hot Water Savings ..................................................................................... 30 Table 3-25: Office Kit Hot Water Measure NEIs ......................................................................................... 31 Table 3-26: Restaurant Kit Hot Water Measure NEIs ................................................................................. 31 Table 3-27: Retail Kit Hot Water Measure NEIs .......................................................................................... 31 Table 3-28: Total Hot Water Measure NEIs Across Kits .............................................................................. 31 Table 3-29: Advanced Power Strip Measure Description ........................................................................... 32 Table 3-30: Advanced Power Strip Verified Electric Savings ...................................................................... 32 Table 3-31: Advanced Power Strip Verification Survey ISR Results ............................................................ 32 Table 3-32: Office Kit Adjusted Savings ...................................................................................................... 33 Table 3-33: Potential Unified Kit Contents ................................................................................................. 33 Table 3-34: Assumed Facility-Level Participant Distribution ...................................................................... 33 Table 3-35: Assumed Facility-Level Electric Water Heat Saturation ........................................................... 34 Table: 3-36 Adjusted Measure Level In-Service Rates Based on Number of Units .................................... 34 Table 3-37: Unified Kit Expected Savings by Measure ................................................................................ 34 Table 4-1: Kit Measures and quantities ...................................................................................................... 36 Table 4-2: Respondent Type ....................................................................................................................... 36 Table 4-3: Number of respondents who did not install some/all of a measure ......................................... 40 Table 4-4: Reasons why respondents did not previously purchase energy efficient items ....................... 41 Table 4-5: Requested Measures ................................................................................................................. 41 Executive Summary 5 1. Executive Summary This report is a summary of the 2021 program year (PY2021) Commercial Energy-Saving Kits (CSK) Program Impact and Process Evaluation for Idaho Power Company (IPC) in the Idaho and Oregon service area. The evaluation was administered by ADM Associates, Inc. (herein referred to as the “Evaluators”). The Evaluators found the impact and process evaluation results for the Commercial Energy-Saving Kits Program to align with similar electric commercial kit programs offered. The impact evaluation resulted in 43% realization rate, which meets the typical realization for kit programs, between 30% and 50%. The Evaluators provide recommendations for adjusting measure-level savings assumptions and altering kit items to increase offerings of desired measures as well as satisfying facility- and customer- level needs. In addition, the Evaluators found the vast majority of responding customers were satisfied or very satisfied with the program (88.4%) and about half of respondents were interested in learning more about other energy efficiency opportunities through Idaho Power (51.6%). The Evaluators conclude that the program is running smoothly and delivers sufficient energy efficiency options to Idaho Power customers. The Evaluators provide recommendations for improving opportunities to increase program satisfaction and provide additional information to program participants about other Idaho Power Company program offerings. 1.1 Savings Results The Evaluators conducted an impact and process evaluation for IPC’s Commercial Energy-Saving Kits Program during PY2021. The Commercial Energy-Saving Kits Program savings amounted to 130,037 kWh with a 43.82% realization rate for the kits overall. The Evaluators summarize the program verified savings in Table 1-1 and Table 1-2. Table 1-1: Commercial Energy-Saving Kits Verified Impact Savings by Facility Type Facility Kits Delivered Claimed Savings (kWh) Verified Savings (kWh) Realization Rate Office 635 112,484 61,770 54.91% Restaurant 218 172,898 57,220 33.09% Retail 53 11,369 11,046 97.16% Total 906 296,751 130,037 43.82% Table 1-2: Commercial Energy-Saving Kits Verified Impact Savings by Measure and Facility Type Facility Measure Claimed Savings (kWh) Verified Savings (kWh) Realization Rate Office 9W A19 11,848 8,812 74.38% Exit Sign LED 27,111 6,113 22.55% Advanced Power Strip 38,473 26,100 67.84% Bathroom Faucet Aerator (1.0 GPM) 20,598 11,080 53.79% Kitchen Faucet Aerator (1.5 GPM) 14,456 9,665 66.85% Evaluation Report 6 Restaurant 9W A19 11,796 897 7.61% Exit Sign LED 16,300 3,008 18.45% Faucet Aerator (1.0 GPM) 53,170 25,601 48.15% Kitchen Faucet Aerator (1.5 GPM) 63,753 12,281 19.26% Pre-Rinse Spray Valve 27,879 15,433 55.36% Retail 9W A19 1,363 1,842 135.16% 8W BR30 6,797 5,527 81.31% Exit Sign LED 1,715 989 57.67% Faucet Aerator (1.0 GPM) 1,494 2,689 180.00% The Evaluators conducted the following evaluation tasks for the PY2021 Commercial Energy-Saving Kits Program impact and process evaluation: ◼ Impact Evaluation o Database review o Survey verification o Virtual verification o Deemed savings review and application ◼ Process Evaluation o Staff interviews o Participant surveys In the following sections, the Evaluators summarize the findings and recommendations resulting from our evaluation activities. 1.2 Conclusions & Recommendations The following section details the Evaluators’ impact and process evaluation conclusions and recommendations for the Commercial Energy-Saving Kits Program. 1.2.1 Impact Evaluation The Evaluators provide the following impact evaluation conclusions and recommendations regarding Idaho Power’s Commercial Energy-Saving Kits Program: First, the Evaluators present the conclusions and recommendations that affect all measures in the program: ◼ Conclusion: The Evaluators verified 130,037 kWh savings at 43.82% realization rate for the Commercial Saving Kits. The Evaluators verified savings and assumptions using the RTF- approved workbooks, the Idaho Power TRM v3.2, and Illinois TRM v9 for the measures included in the program. The discrepancy in realization rate is due to the large differences between assumed in-service rates (ISRs) based on the 2020 participant survey and the verified in-service rates calculated from participant responses to verification surveys as part of this evaluation. The Evaluators note that the difference in in-service rates between 2020 and 2021 is unusually large, Evaluation Report 7 given that each of the survey efforts achieved 90/10 precision and confidence. However, it may indicate that the provided measures are utilized less in current small business applications. ▪ Recommendation #1: To more accurately estimate verified savings, the Evaluators recommend IPC continue to update their ISR assumptions when calculating claimed savings for future program years. ◼ Conclusion: The Evaluators found that office, restaurant, and retail participants displayed an electric water heat saturation rate of 56%, 40%, and 90%, respectively. ▪ Recommendation #2: The Evaluators recommend IPC continue to update their electric water heat saturation assumptions when calculating claimed savings for future program years. ◼ Conclusion: The Evaluators found that the restaurant participants displayed significantly lower in-service rates for general service LEDs than expected due to lack of need for the item, the item did not fit, or management did not have time to install. ◼ Conclusion: The lighting measures displayed verified savings of 27,188 kWh with a realization rate of 35.34% compared to claimed IPC savings. The general lighting realization rate is being driven by the low verified in-service rates for restaurant LEDs (7% ISR) and Exit Sign LEDs across all facility types (6% ISR). In nearly all measures, the verified in-service rates resulting from participant surveys done as part of this evaluation are lower than the in-service rates Idaho Power had used to calculate claimed savings. ◼ Conclusion: The Evaluators reviewed measure-level engineering algorithms and savings sources to measure verified savings. For the lighting measures, the Evaluators found that differences in the expected savings and the adjusted savings for LED measures arise from lack of application of space heating and space cooling interactive effects. The verified adjusted savings the Evaluators calculated has used heating and cooling interactive effects sourced from the Idaho Power TRM v3.2 based on the facility type of the installed measure. The expected savings calculated by IPC did not integrate interactive effects, and therefore display lower expected savings than verified adjusted savings. This difference in methodology led to greater than 100% realization rates for verified adjusted savings. ▪ Recommendation #3: The Evaluators recommend IPC include space heating and space cooling interactive effects when calculating claimed savings for lighting measures in the future. ◼ Conclusion: For the lighting measures, IPC had calculated claimed savings using “Other” facility type hours of use (3,800 annual hours) for retail applications whereas the Evaluators estimated verified savings using a blended value of retail facility types (4,533 annual hours) from the TRM. This difference in methodology led to greater than 100% realization rates for verified adjusted savings. ▪ Recommendation #4: The Evaluators recommend IPC alter assumed hours of use for retail applications to 4,533 hours per year. ◼ Conclusion: The Evaluators note that the EISA backstop, which will be enforced July 1, 2023, requires that all general service lamps sold must display 45 lumens per watt. This code effectively changes the measure baseline to display efficiency values equivalent to LEDs. Therefore, any programs which incentivize the purchase of LED general service lamps no longer produce energy savings compared to the baseline. Evaluation Report 8 ▪ Recommendation #5: The Evaluators recommend that IPC plan to remove LED measures from the Commercial Energy-Saving Kits Program. The resulting verified savings for the measure will be claimable until July 1, 2023. After this date, third party evaluators must assume that all unqualified lighting measures have been replaced by LED measures due to burnout. ◼ Conclusion: The hot water measures displayed verified savings of 76,749 kWh with a realization rate of 42% compared to the claimed savings for these measures. The expected savings used to determine the realization rate were found by multiplying the savings per measure of the hot water measures included in kits by the total number of each measure sent out in kits during PY2021. ◼ Conclusion: The Evaluators found the expected savings assumptions for the bathroom and faucet aerators were appropriate and valid, and therefore did not apply adjustments to IPC expected savings for these measures. The Evaluators made no adjustments to the PRSV expected savings methods. This led to no savings adjustments for the faucet aerator measures and PRSV measures between expected and adjusted savings (assuming 100% ISR and 100% water heat saturation). Therefore, the discrepancy in the verified savings realization rates (43% realization rate) stem almost solely from the difference in assumed and verified ISRs and electric water heat saturation rates. ◼ Conclusion: The Evaluators found that participant survey responses observed in-service rates for faucet aerators between 24% and 31% across facility types, while the PRSV measure displayed in- service rates of 55%. ◼ Conclusion: The advanced power strip measure displayed verified savings of 26,100 kWh with a realization rate of 68% compared to the claimed savings for the measure. The restaurant and retail kits did not provide this measure. The Evaluators reviewed and applied the current RTF UES values for the advanced power strip measure and found a minor reference error resulting in 0.31% higher adjusted savings. The discrepancy in the verified savings realization rate (68% realization) stems almost solely from the difference in assumed and verified ISRs. ◼ Conclusion: The Evaluators found that participant survey responses observed in-service rates for advanced power strips in office businesses was 63% as opposed to the assumed ISR of 94%. ◼ Conclusion: As part of the evaluation, the Evaluators estimated non-energy benefits (NEBs) and non-energy impacts (NEIs) from the measures offered through the Commercial Energy-Saving Kits Program. The Evaluators verified the following NEBs and NEIs across all measures and facility types: $40.28 in verified Annual NEBs, 4.88 kW, and -406.28 Therms. 1.2.2 Process Evaluation The Evaluators provide the following process evaluation conclusions and recommendations regarding Idaho Power’s Commercial Savings Kit Program: ◼ Conclusion: The vast majority of responding customers were satisfied or very satisfied with the program (88.4%) and about half of respondents were interested in learning more about other energy efficiency opportunities through Idaho Power (51.6%). Many customers indicated interest in conducting additional upgrades and retrofits, such as installing occupancy sensors for lighting, and water heating and space heating upgrades. ◼ Recommendation # 6: The Evaluators recommend that IPC provide more opportunities for participating customers to learn about other offerings IPC provides. Evaluation Report 9 ◼ Conclusion: The majority of respondents who remembered receiving a kit indicated they installed at least one measure from the kit (95.6%). LED retrofit kits for exits signs were the most common item not installed by respondents, followed by pre-rinse spray valve, low-flow kitchen faucet aerators, and low-flow bathroom faucet aerator. The most common reasons for respondents provided for not installing these items included not needing the item, the item did not fit, and not having time to install them. The Evaluators note that IPC has removed the pre-rinse spray valves from the new kit offering for future program years due to RTF deactivation of the measure. IPC has also reduced the number of exit sign kits and bathroom aerators due to low installation rates from the 2020 survey. ◼ Recommendation #7: Evaluators recommend Idaho Power staff reconsider the inclusion of retrofit exit signs and low-flow aerators altogether for kits moving forward. Although these measures can garner energy savings, they are not popular among kit recipients and thus may not be cost-effective measures to provide consumers. ◼ Conclusion: In general, respondents noted they had not previously purchased the energy efficiency items included in the kit because they did not know enough about the item. ◼ Conclusion: Some participants were interested in receiving more LED lights, as well as occupancy sensors and timers in future kits. ◼ Recommendation #8: Expanding upon Recommendation #7, rather than provide unwanted measures, such as retrofit exit signs, pre-rinse spray valves, and low-flow aerators, Idaho Power staff should consider providing other measures such as occupancy sensors, as customers indicate a desire for such applications. Evaluation Report 10 2. General Methodology The Evaluators completed an impact evaluation for each of the measures included in the Commercial Energy-Saving Kits Program. Our general approach for this evaluation considers the cyclical feedback loop among program design, implementation, impact evaluation, and process evaluation. Our activities estimate and verify annual energy savings and identify whether the program is meeting its goals. This is aimed to provide guidance for continuous program improvement. The Evaluators summarize the research objectives for the impact and process evaluation for this program here: 1. Determine and verify the energy impacts (kWh) as well as ex-post realization rates attributable to the Commercial Energy-Saving Kit Program for the 2021 program year; 2. Verify installation and operating conditions of equipment remotely via livestream/video call platform; 3. Develop estimates of program non-electric impacts (NEIs) and non-energy benefits (NEBs); 4. Evaluate program design1, implementation2, and administration3; 5. Review customer surveys and offer guidance on program improvement; and 6. Report findings and observations from the evaluation and make recommendations to assist IPC in enhancing the effectiveness of programs and more accurately and transparently reporting program savings in future program cycles. Furthermore, our team collected data on program performance, design, and administration. We synthesized these data to identify gaps in program design and barriers to program implementation. This synthesis allows development of recommendations for program improvement that are grounded in the existing design and based on real-world feedback. The Evaluators used the following approaches to accomplish the impact-related research goals listed above and calculate energy impacts defined by the International Performance Measurement and Verification Protocols (IPMVP)4 and the Uniform Methods Project (UMP)5: ◼ Simple verification (web-based surveys supplemented with phone surveys) ◼ Document verification (review project documentation) ◼ Deemed savings (RTF UES, Illinois Technical Reference Manual version 9.0) The Evaluators used the following approaches to accomplish the process-related research goals and complete the research objectives identified by IPC for the program: ◼ Staff interviews ◼ Participant surveys The M&V methodologies are determined by previous Idaho Power evaluation methodologies as well as the relative contribution of a given program to the overall energy efficiency impacts. The Evaluators 1 Including program mission, logic, and use of industry best practices 2 Including quality control, operational practice, and outreach 3 Including program oversight, staffing, management, training, documentation, and reporting 4 https://www.nrel.gov/docs/fy02osti/31505.pdf 5 https://www.nrel.gov/docs/fy18osti/70472.pdf Evaluation Report 11 reviewed relevant information on infrastructure, framework, and guidelines set out for EM&V work in several guidebook documents that have been published over the past several years. These include the following: ◼ Northwest Power & Conservation Council Regional Technical Forum (RTF)6 ◼ Illinois Technical Reference Manual (TRM) version 9.07 ◼ National Renewable Energy Laboratory (NREL), United States Department of Energy (DOE) The Uniform Methods Project (UMP): Methods for Determining Energy Efficiency Savings for Specific Measures, April 20138 ◼ International Performance Measurement and Verification Protocol (IPMVP) maintained by the Efficiency Valuation Organization (EVO) with sponsorship by the U.S. Department of Energy (DOE)9 The Evaluators kept data collection instruments, calculation spreadsheets, programming code, and survey data available for Idaho Power records. 2.1 Glossary of Terminology As a first step to detailing the evaluation methodologies, the Evaluators have provided a glossary of terms to follow: ◼ Deemed Savings – An estimate of an energy savings outcome for a single unit of an installed energy efficiency measure. This estimate (a) has been developed from data sources and analytical methods that are widely accepted for the measure and purpose and (b) are applicable to the situation being evaluated. ◼ Expected Savings – Calculated savings used for program and portfolio planning purposes. ◼ Verified Savings – Savings estimates after the unit-level savings values have been updated and energy impact evaluation has been completed, integrating results from appropriate RTF UES and Illinois TRM values. ◼ Gross Savings – The change in energy consumption directly resulting from program-related actions taken by participants in an efficiency program, regardless of why they participated. ◼ Free Rider – A program participant who would have implemented the program measure or practice in absence of the program. ◼ Net-To-Gross – A factor representing net program savings divided by gross program savings that is applied to gross program impacts to convert them into net program load impacts. ◼ Net Savings – The change in energy consumption directly resulting from program-related actions taken by participants in an efficiency program, with adjustments to remove savings due to free ridership. ◼ Non-Energy Benefits – Quantifiable impacts produced by program measures outside of energy savings (comfort, health and safety, reduced alternative fuel, etc.). 6 https://rtf.nwcouncil.org/measures 7 https://www.ilsag.info/technical-reference-manual/il-trm-version-9/ 8 Notably, The Uniform Methods Project (UMP) includes the following chapters authored by ADM. Chapter 9 (Metering Cross- Cutting Protocols) was authored by Dan Mort and Chapter 15 (Commercial New Construction Protocol) was Authored by Steven Keates. 9 Core Concepts: International Measurement and Verification Protocol. EVO 100000 – 1:2016, October 2016. Evaluation Report 12 ◼ Non-Energy Impacts – Quantifiable impacts in energy efficiency beyond the energy savings gained from installing energy efficient measures (reduced cost for operation and maintenance of equipment, reduced environmental and safety costs, etc.). 2.2 Summary of Approach This section presents our approach to accomplishing the impact and process evaluation of Idaho Power’s Commercial Energy-Saving Kits Program. This chapter is organized by evaluation objective. Section 2.2.2.3 and Section 3 describe the Evaluators’ measure-specific impact evaluation methods and results in further detail and Section 2.2.4 and Section 3.3.3.3 describe the Evaluator’s process evaluation methods and results. The Evaluators outline the approach for verifying, measuring, and reporting the program impacts as well as summarizing potential program improvements. The primary objective of the impact evaluation is to determine ex-post verified net energy savings. On-site verification and equipment monitoring was not conducted during this impact evaluation, however, the Evaluators completed virtual verification for a sample of projects. Our general approach for this evaluation considers the cyclical feedback loop among program design, implementation, and impact evaluation. Our activities during the evaluation estimate and verify annual energy savings and identify whether the program is meeting its goals. These activities are aimed to provide guidance for continuous program improvement and increased cost effectiveness for future program years. The Evaluators employed the following approach to complete impact evaluation activities for the program. The Evaluators define one major approach to determining net savings for Idaho Power’s Commercial Energy-Saving Kits Program: ◼ A Deemed Savings approach involves using stipulated savings for energy conservation measures for which savings values are well-known and documented. These prescriptive savings may also include an adjustment for certain measures, such as baseline adjustments for hot water measures in which RTF annual water usage may differ from Illinois TRM values. The Evaluators accomplished the following quantitative goals as part of the impact evaluation: ◼ Verify savings with 10% precision at the 90% confidence level; ◼ Cross-verify customer-reported survey values with virtual verification efforts; and, ◼ Where appropriate, apply the RTF or Illinois TRM to verify measure impacts. The Evaluators calculated verified savings for each measure based on the RTF UES or Illinois TRM in combination with the results from document review. The Evaluators also applied in-service rates (ISRs) from verification surveys for measures which exceeded 90/10 precision requirements from survey responses. Evaluation Report 13 2.2.1 Database Review At the outset of the evaluation, the Evaluators reviewed the databases to ensure that the program tracking database conforms to industry standards and adequately tracks key data required for evaluation. Measure-level net savings were evaluated primarily by reviewing measure algorithms and values in the tracking system to assure that they are appropriately applied using the Regional Technical Forum Unit Energy Savings (UES) or engineering equations and appropriate assumptions sourced from the Illinois TRM. The Evaluators then aggregated and cross-verify program and measure totals. The Evaluators reviewed program documents including savings source workbooks, delivered technical reference manuals, and supplemental calculations to verify the tracking data accurately represents the program kit contents, total participants, and expected savings for each measure. 2.2.2 Verification Methodology The Evaluators verified a sample of participating small businesses for verification of measure installation through web-based surveys. The Evaluators used the following equations to estimate survey completion requirements for the program in order to achieve 10% precision at the 90% confidence level. Required number of responses were estimated as follows: Equation 2-1: Sample Size for Infinite Sample Size 𝑛= (𝑍× 𝐶𝑉 𝑑) 2 Equation 2-2: Sample Size for Finite Population Size 𝑛0 = 𝑛 1 +(𝑛 𝑁) Where, ◼ 𝑛 = Sample size ◼ 𝑍 = Z-value for a two-tailed distribution at the assigned confidence level. ◼ 𝐶𝑉 = Coefficient of variation ◼ 𝑑 = Precision level ◼ 𝑁 = Population For a sample that provides 90/10 precision, Z = 1.645 (the critical value for 90% confidence) and d = 0.10 (or 10% precision). The remaining parameter is CV, or the expected coefficient of variation of measures for which the claimed savings may be accepted. A CV of .5 was assumed for the program due to the Reported Savings Database Review Document Review Survey Verification Virtual Verification Evaluated Savings Evaluation Report 14 homogeneity of participation10, which yields a sample size of 68 for an infinite population. Sample sizes were adjusted for smaller populations via the method detailed in Equation 2-2. The following sections describe the Evaluator’s methodology for conducting survey-based verification and virtual verification. 2.2.2.1 Response Goals The Evaluators developed a sampling plan that achieves a sampling precision of ±10% at 90% statistical confidence – or “90/10 precision” – to estimate the percentage of projects for which the claimed savings are verified or require some adjustment. The Evaluators developed the following samples for the program’s verification survey efforts using Equation 2-1 and Equation 2-2. The Evaluators ensured representation for each measure. Table 2-1: Survey-based Verification Completion and Precision by Facility Type Facility Type Kit Population Completions (With Finite Population Adjustment) * Precision at 90% CI Office 635 60 90% Confidence ±8.67% Precision Restaurant 218 20 Retail 53 10 Total 906 90 *Assumes sample size of 68 for an infinite population, based on CV (coefficient of variation) = 0.5, d (precision) = 10%, Z (critical value for 90% confidence) = 1.645. The Evaluators achieved 90 completed survey responses toward the impact and process evaluation activities for this program and surveyed a total of 600 participating customers to verify installation as well as gather customer satisfaction with the equipment, program, and utility in general. The table above represents the number of rebates sampled in the Idaho and Oregon territories combined. 2.2.2.2 Survey-Based Verification The Evaluators conducted survey-based verification for the Commercial Energy-Saving Kits Program, described in the sections above. The primary purpose of conducting a verification survey is to confirm that the participant had indeed received the kit, that the measure was installed, and that the measure is still currently operational. The Evaluators used the sample plan provided previously in Table 2-1 for the program simple verification task. The Evaluators developed a sampling plan that achieved a sampling precision of ±8.00% at 90% statistical confidence for ISRs estimates at the measure-level during web-based survey verification. The Evaluators implemented a web-based survey to complete the verification surveys. The findings from these activities served to estimate ISRs for each measure surveyed, separated by facility type. These ISRs 10 Assumption based off California Evaluation Framework: https://www.cpuc.ca.gov/uploadedFiles/CPUC_Public_Website/Content/Utilities_and_Industries/Energy/Energy_Programs/De mand_Side_Management/EE_and_Energy_Savings_Assist/CAEvaluationFramework.pdf Evaluation Report 15 were applied to kit-level verified savings. ISRs were summarized and applied by measure and facility type. The measure-level ISRs resulting from the survey-based verification are summarized in Section 3.1. 2.2.2.3 Virtual Verification In August and September 2022, the Evaluator completed 6 virtual verifications with Idaho Power Commercial Energy-Saving Kits Program participants. These virtual verification interviews informed the impact evaluation and addressed research questions on measures installed and not installed through the program. Idaho Power provided a list of 600 unique participants for the 2021 program year. From that list, we recruited 31 potential respondents via email and phone form. We contacted all respondents and completed virtual verifications from 6 participants (Table 2-2). Table 2-2: Virtual Verification Summary Disposition Count Complete 6 Partial complete 0 Nonresponse 20 Refused 4 Bad number 1 Total 31 The Evaluators attempted to reach customers up to three times and offered a $50 gift card to all participants that completed the virtual verification. The virtual verification efforts, conducted by smartphone link, averaged about 30 minutes, and were recorded with permission of the respondent. The Evaluators developed a sampling plan to achieve a sampling precision of ±20% at 90% statistical confidence – or “90/20 precision” – to estimate the percentage of projects for which the claimed savings are verified or require some adjustment. However, due to lack of responses through recruitment emails, nonresponse, and refusal, the Evaluators did not meet the 20% precision goal. The Evaluators achieved 6 total virtual verification completions at 31.88% precision at the 90% confidence interval. The Evaluators completed the following samples for the program’s document review using Equation 2-1 and Equation 2-2. Table 2-3: Virtual Verification Completions and Precision by Facility Type Facility Type Kit Population Completions (With Finite Population Adjustment)* Precision at 90% CI Office 635 3 90% Confidence ±31.88% Precision Restaurant 218 2 Retail 53 1 Total 906 6 *Assumes sample size of 68 for an infinite population, based on CV (coefficient of variation) = 0.5, d (precision) = 10%, Z (critical value for 90% confidence) = 1.645. Evaluation Report 16 Although web survey efforts did not meet precision requirements, the Evaluators found that the survey responses aligned with the information gathered through web surveys with these customers. 2.2.3 Impact Evaluation Methodology The Evaluators employed a deemed savings approach to quantify program impacts for the Commercial Energy-Saving Kits Program. The Evaluators completed the steps outlined below to complete the impact evaluation for the program. 1. Deliver a detailed data request outlining the information we require for each kit type. 2. Complete a thorough and comprehensive summary of calculated savings. 3. Validate that appropriate inputs to deemed savings and engineering algorithms were used for each measure. 4. Apply observed in-service rates and observed electric water heater saturation rates acquired through web-based survey responses. 5. Verify the gross energy (kWh) savings that are a result of the program. 6. Summarize and integrate the impact evaluation findings into the final report. The Evaluators completed the validation for specific measures across each program using the RTF unit energy savings (UES) values, where available. The Evaluators ensured the proper measure unit savings were recorded and used in the calculation of IPC’s ex-ante measure savings. The Evaluators requested and used the RTF workbooks and Illinois TRM employed during calculation of ex-ante measure savings. The Evaluators documented any cases where recommended values differed from the specific unit energy savings workbooks used by IPC. In cases where the RTF has existing unit energy savings (UES) applicable to IPC’s measures, the Evaluators verified the quantity and quality of installations and apply the RTF’s UES to determine verified savings. In cases where the RTF does not define UES for the measure, the Evaluators reviewed and applied savings values derived from the TRMs/workpapers presented in Table 2-4. Table 2-4: Impact Analysis Methodology by Measure End Use Measure Impact Analysis Methodology Lighting 9W A19 IPC TRM v3.2 Section 1.7 & 2.1 8W BR30 IPC TRM v3.2 Section 1.7 & 2.1 Exit Sign LED IPC TRM v3.2 Section 1.7 & 2.1 Hot Water Faucet Aerator (1 GPM) IL v9 TRM Section 4.3.2 Faucet Aerator (1.5 GPM) IL v9 TRM Section 4.3.2 Pre-Rinse Spray Valve RTF UES ComCookingPreRinseSprayValve_v2_5 Advanced Power Strip Advanced Power Strip RTF UES ComAdvancedPowerStrip_v4_1 The Evaluators detail measure-specific impact evaluation methodologies in Section 3.2. Evaluation Report 17 2.2.4 Process Evaluation Methodology The process evaluation of the Commercial Energy-Saving Kits Program was designed to accomplish the following research objectives: ◼ Evaluate program design including program mission, logic, and use of industry best practices; ◼ Evaluate program implementation including quality control, operational practice, outreach, and ease of customer participation; ◼ Evaluate program administration including program oversight, staffing, management, training, documentation, and reporting; ◼ Report findings, observations, and recommendations to enhance program effectiveness; ◼ Refine and refocus marketing strategies and increase program effectiveness; ◼ Provide recommendations for changing the program’s structure, management, administration, design, delivery, operations, or target; and ◼ Help program designers and managers structure programs to achieve cost-effective savings. The process evaluations will focus on documenting the effects that the program activity had on encouraging installations of the energy efficiency measure or influencing the customer to make an energy-efficiency decision. The key research objectives in these process evaluations are the following: ◼ Evaluate program design including program mission, logic, and use of industry best practices; ◼ Evaluate program implementation including quality control, operational practice, and outreach; ◼ Review program forms, manuals, marketing and kit materials, and provide recommendations for improvement, as needed; ◼ Evaluate program administration including program oversight, staffing, management, training, documentation and reporting; ◼ Review customer surveys and offer guidance on program improvement; and ◼ Report findings and observations and recommendations to enhance program effectiveness. The process evaluation was designed to ensure that best practices and lessons learned from individual programs are then shared and incorporated across the entire program portfolio. Customer participant surveys contain a standard set of questions to be addressed across all IPC programs to facilitate evaluation among and between programs. To achieve these objectives, the Evaluation team engaged in the research activities described in the sections below. 2.2.4.1 Documentation Review The Evaluator reviewed materials on the program website including program marketing materials provided by program staff. This review provided a general understanding of the program design and implementation practices. The review also provided context for informing the interviews with program staff. 2.2.4.2 Program Staff Interviews The Evaluators interviewed four IPC program staff. The interviews covered the following topics. Evaluation Report 18 ◼ Staff and partner roles in the program; ◼ The measures covered by the program and the decision processes used when considering measure offerings; ◼ Program marketing approaches; ◼ Past changes and future planned changes to the program; ◼ Clarification of the objectives for the process evaluation. 2.2.4.3 Participant Survey The Evaluators administered a survey to customers who participated in the 2021 program. The objective of the survey was to collect data on the following components: ◼ Sources of program awareness and motivations for participating; ◼ Customer experiences with the program and overall satisfaction; ◼ Measure specific questions related to how the installed equipment was utilized; and ◼ Facility space and water heating characteristics. The Evaluator developed the survey guide in conjunction with Idaho Power staff to address the above objectives through various questions to the participating customers. The survey questions are provided in Appendix A: Participant Survey. 2.2.5 Data Collection The following primary data collection activities were completed to support the evaluation of the Commercial Energy-Saving Kits Program. 2.2.5.1 Program Staff Interviews Evaluators interviewed four Idaho Power Staff to learn more about the history, purpose, and design of the Commercial Savings Kit program. Interviewees included two analysts and two program specialists, all of whom are involved in the Commercial Savings Kit program. 2.2.5.2 Participant Survey The Evaluators administered a survey to customers who participated in the 2021 program. The participant survey responses were used to inform the process evaluation, verify the measure installations, and gather information of customer satisfaction with the kit contents and the program overall. The survey was administered online, and customers were recruited by email in July 2022. Each customer received up to three emails asking them to complete the survey. Customers were offered a $25 electronic gift card for completing the survey. Customers with inactive IPC accounts were excluded from the survey sample. Table 2-5 summarizes the survey data collection. The survey efforts received 98 program participants responses; however, 8 of those 98 did not remember receiving the kits, and therefore did not complete the survey. The survey effort received 90 total survey completions with an overall response rate of 15.0%. Evaluation Report 19 Table 2-5: Summary of Survey Data Collection Facility Type Number of Kits Number of Emailed Surveys Number of Survey Completes Response Rate Office 635 432 60 13.89% Restaurant 218 124 20 16.13% Retail 53 44 10 22.73% Total 906 600 90 15.00% Table 2-6 compares the distributions of measures installed at participating sites to those who completed the survey. As shown, the survey sample was fairly representative of the participant population in terms of facility type and number of responses. Table 2-6: Distribution of Measures Installed at Participating Sites and Installed by Survey Respondents Facility Type Number of Kits Proportion of Kit Type Number of Survey Responses Proportion of Survey Responses Office 635 70% 60 67% Restaurant 218 24% 20 22% Retail 53 6% 10 11% Total 906 - 90 - 2.2.6 Net-To-Gross The Northwest RTF UES measures do not require NTG adjustments as they are built into the deemed savings estimates. However, the Evaluators employed the Illinois TRM to calculate verified savings for the faucet aerator measures. For this measure, “NTG” is intertwined with baseline – savings from faucet aerators are based on their difference between the pre-condition gallons per minute (GPM) aerator and the new, efficient faucet aerator GPM. For this reason, the Evaluators used baseline estimates provided in deactivated RTF workbooks when appropriate in order to capture the current practice baseline. Further details are provided in the impact evaluation results section for the hot water measures in Section 3.3.1.3. 2.2.7 Non-Energy Impacts & Non-Energy Benefits The Evaluators used the Regional Technical Forum (RTF) to quantify non-energy impacts (NEIs) and/or non-energy benefits (NEBs) for residential measures with established RTF values where available. Measures with quantified NEBs include lighting end-use measures. Measures with quantified NEIs include hot water end-use measures. Further details are provided in the measure-level impact evaluation result section in Section 3.3. Executive Summary 20 3. Impact Evaluation Results The Evaluators completed an impact evaluation on Idaho Power’s Commercial Energy-Saving Kit (CSK) Program to verify program-level and measure-level energy savings for PY2021. The following sections summarize findings for the electric impact evaluation in the program in the Idaho and Oregon service area. The Evaluators used data collected from participant surveys and applicable Regional Technical Forum (RTF) workbooks, technical reference manuals (TRMs), and workpapers to evaluate savings. In PY2021, Idaho Power completed and provided incentives for commercial electric measures in Idaho and Oregon under the Commercial Energy-Saving Kits Program. Kits were sent to small businesses within the following categories: Office, Restaurant, and Retail. The contents of each kit provided are dependent on the facility type of each participant, however, the measures offered through the program include LEDs, bathroom faucet aerators, kitchen faucet aerators, pre-rinse spray valves, advanced power strips, and LED exit signs. The Evaluators summarize kit contents by facility type in the table below: Table 3-1: Kit Contents Summary Facility Type Measure Restaurant (3) 9W A19 LED (2) Bathroom Faucet Aerator (1.0 GPM) (2) Kitchen Faucet Aerator (1.5 GPM) (2) Exit Sign LED (1) Pre-Rinse Spray Valve Retail (2) 9W A19 LED (2) 8W BR30 LED (1) Bathroom Faucet Aerator (1.0 GPM) (2) Exit Sign LED Office (2) 9W A19 LED (2) Bathroom Faucet Aerator (1.0 GPM) (1) Kitchen Faucet Aerator (1.5 GPM) (2) Exit Sign LED (1) Advanced Power Strip Table 3-2 summarizes the CSK Program verified impact savings by measure. Claimed savings for this table represent the expected savings for each kit extrapolated to the population of surveyed kits and adjusted to reflect expected in-service rates (ISRs). The Evaluators determined verified savings by reviewing and adjusting expected deemed savings and by applying verified ISRs and electric water heating saturation rates resulting from program participant surveys. The Evaluators summarize the measure-level and total program verified savings in Table 3-2. Table 3-2: Commercial Energy-Saving Kits Program Verified Impact Savings by Measure Measure Claimed Savings (kWh) Verified Savings (kWh) Realization Rate 9W A19 LED 25,007 11,552 46.19% 8W BR30 LED 6,797 5,527 81.31% Exit Sign LED 45,126 10,109 22.40% Bathroom Faucet Aerator (1.0 GPM) 75,261 39,370 52.31% Evaluation Report 21 Measure Claimed Savings (kWh) Verified Savings (kWh) Realization Rate Kitchen Faucet Aerator (1.5 GPM) 78,209 21,946 28.06% Pre-Rinse Spray Valve 27,879 15,433 55.36% Advanced Power Strip 38,473 26,100 67.84% Total 296,751 130,037 43.82% *The total differs by 3 kWh due to small rounding differences between reported savings and workbook expected savings The Evaluators found the Commercial Energy-Saving Kits Program resulted in 130,037 kWh of verified savings, displaying a 43.82% realization rate against the IPC-claimed savings of 296,751 kWh for the program. The Evaluators provide facility-type verified savings and realization rates by measure in Table 3-3. Table 3-3: Commercial Energy-Saving Kits Program Verified Impact Savings by Measure and Facility Type Measure Facility Claimed Savings (kWh) Verified Savings (kWh) Realization Rate 9W A19 LED Office 11,848 8,812 74.38% Restaurant 11,796 897 7.61% Retail 1,363 1,842 135.16% 8W BR30 LED Retail 6,797 5,527 81.31% Exit Sign LED Office 27,111 6,113 22.55% Restaurant 16,300 3,008 18.45% Retail 1,715 989 57.67% Bathroom Faucet Aerator (1.0 GPM) Office 20,598 11,080 53.79% Restaurant 53,170 25,601 48.15% Retail 1,494 2,689 180.00% Kitchen Faucet Aerator (1.5 GPM) Office 14,456 9,665 66.85% Restaurant 63,753 12,281 19.26% Pre-Rinse Spray Valve Restaurant 27,879 15,433 55.36% Advanced Power Strip Office 38,473 26,100 67.84% Total 296,751 130,037 43.82% *The total differs by 3 kWh due to small rounding differences between reported savings and workbook expected savings Total realization rates for the program result in 43.82%. The primary factor in the low realization rates are the differences between assumed ISRs, based on the 2020 participant survey, and the verified ISRs and electric water heat saturation resulting from evaluation survey efforts. Verified ISRs were lower than IPC ISRs for nearly all measures and verified electric water heat saturation was lower than claimed saturation for all facility types. The ISRs and electric water heat saturation assumptions are crucial factors in determining verified savings, resulting in the lower realization rates across the board. To determine ISR and electric water heat saturation rates, the Evaluators sent surveys to 600 unique contacts of program participants in PY2021. The following table provides the breakdown of participants, contacts, and responses by facility type. Evaluation Report 22 Table 3-4: Commercial Energy-Saving Kits Delivered in PY2021 Facility Participants Customers Surveyed Survey Respondents Office 635 432 60 Restaurant 218 124 20 Retail 53 44 10 Total 906 600 90 Survey results were used to develop an in-service rate (ISR), which was applied to the program population and savings per kit to determine total verified program savings. 3.1 Simple Verification Results The Evaluators surveyed participant customers between July and August of 2022 using a web approach (online survey). The Evaluators deployed 600 surveys and received responses from 98 unique customers that participated in Idaho Power’s CSK Program. Customers with a valid email were sent the survey via an email invitation. The Evaluators summarize the aggregate results of the survey in Table 3-5. Table 3-5: Simple Verification Survey Response Rate Measurement Number of Project Sites Population 906 Customers Contacted by Email 600 Survey Responses 98 Response Rate 16.3% 3.1.1 In-Service Rates The Evaluators calculated in-service rates of installed measures from the collection of 98 responses to the simple verification survey, detailed above. The Evaluators asked participants if they remembered receiving the kit and whether the equipment provided in the kit is currently installed and operational. The in-service rates of the measures by facility are presented in Table 3-6. Table 3-6: Verified In-Service Rates by Measure and Facility Type Measure Office Restaurant Retail 9W A19 63% 7% 90% 8W BR30 - - 40% Faucet Aerator (1 GPM) 24% 45% 60% Faucet Aerator (1.5 GPM) 29% 15% - Pre-Rinse Spray Valve - 55% - Advanced Power Strip 63% - - LED Exit Sign 5% 8% 10% In contrast, the assumed in-service rates used by Idaho Power staff in the development of the claimed kWh savings for the program are as follows: Evaluation Report 23 Table 3-7: Assumed In-Service Rates by Measure and Facility Type Measure Office Restaurant Retail 9W A19 90% 92% 85% 8W BR30 - - 63% Faucet Aerator (1 GPM) 41% 69% 50% Faucet Aerator (1.5 GPM) 40% 58% - Pre-Rinse Spray Valve - 74% - Advanced Power Strip 94% - - LED Exit Sign 32% 56% 24% The in-service rates used by Idaho Power were based on the survey results collected from respondents in 2020, which also met 90/10 confidence and precision. The differences between the in-service rates verified by the Evaluators and the in-service rates assumed led to the large discrepancies in realization rates across measures. In all cases except for retail 9W A19 LEDs and retail bathroom faucet aerators, the IPC-applied in-service rates are lower than the in-service rates resulting from the Evaluator’s participant survey responses. Although the number of responses from the 2020 survey outnumbered the number of responses from the 2021 survey deployed during the evaluation, the responses in the 2021 survey indicated much lower in-service rates. The drastic change in in-service rates year-over-year is atypical. The Evaluators speculate that the in-service rates may have been impacted due to large changes in small business operations, productivity, and management since COVID-19 impacts. Therefore, the Evaluators expect that the in-service rates displayed in the 2021 survey will be more aligned with future in-service rates for the program moving forward. 3.2 Non-Energy Benefits and Non-Energy Impacts As part of the evaluation, the Evaluators estimated non-energy benefits (NEBs) and non-energy impacts (NEIs) resulting from the Commercial Energy-Saving Kits Program. The table below summarizes the total NEBs and NEIs verified through the evaluation for this program. Table 3-8: Total Verified NEBs and NEIs End-Use Verified Annual NEBs ($) Verified kW Savings Verified Therms Savings Verified Water Savings (Gallons) Lighting $40.28 9.98 -820.25 N/A Hot Water - 4.46 3,987.89 1,547,524.73 Advanced Power Strips - - - - Total $40.28 14.44 3,167.64 1,547,524.73 The Evaluators estimated NEBs and NEIs using the savings sources defined for each measure in the measure-level sections below. 3.3 Measure-Level Impact Evaluation Results The Evaluators summarize the program- and measure-specific impact analysis activities and results for the Commercial Energy-Saving Kits Program in the sections below. Evaluation Report 24 3.3.1 Lighting The Commercial Saving Kits Program includes various LED lighting equipment in each of the office, restaurant, and retail kits. Included in every kit is at least two general purpose 9W screw-in A19 LEDs and two exit sign LEDs. Two 8W BR30 LEDs are also included in the retail kits. Table 3-9 summarizes the lighting measures offered under this program. Table 3-9: Lighting Measure Description Measure Description Impact Analysis Methodology 9W A19 9W general purpose screw-in LED. Assumed to be replacing a 13W CFL Bulb Idaho Power TRM v3.2 Section 1.7 & 2.1 8W BR30 8W BR30 bulb. Assumed to be replacing a 35W Halogen Bulb Idaho Power TRM v3.2 Section 1.7 & 2.1 Exit Sign LED 4W dual-sided LED Exit Sign. Assumed to be replacing a 14W dual-sided CFL Exit Sign. Idaho Power TRM v3.2 Section 1.7 & 2.1 Table 3-10 summarizes the verified electric energy savings resulting from the impact evaluation of the Commercial Energy-Saving Kits Program lighting measures. Table 3-10: Lighting Measure Population Verified Savings Measure Facility Claimed Savings (kWh) Verified Savings (kWh) Realization Rate 9W A19 LED Office 11,848 8,812 74.38% Restaurant 11,796 897 7.60% Retail 1,363 1,842 135.14% 8W BR30 LED Retail 6,797 5,527 81.32% Exit Sign LED Office 27,111 6,113 22.55% Restaurant 16,300 3,008 18.45% Retail 1,715 989 57.67% Total 76,930 27,188 35.34% The lighting measures displayed verified savings of 27,188 kWh with a realization rate of 35.34% compared to claimed IPC savings. The general lighting realization rate is being driven by the low verified in-service rates for restaurant LEDs (7% ISR) and Exit Sign LEDs across all facility types (6% ISR). The Evaluators summarize the measure-specific in-service rates and further details of verified savings for the lighting measures in the sections below. 3.3.1.1 In-Service Rates The Evaluators randomly selected a subset of participant customers to survey for simple verification of installed measure. The Evaluators determined whether the provided measures were installed at the business or if there were any plans to install the provided equipment in the future. An ISR for each measure by facility type was developed using the number of each measure installed and the total number of measures. Table 3-11 displays the ISRs for each of the lighting measures offered in each of the kits. Evaluation Report 25 Table 3-11: Lighting Measure Verification Survey ISR Results Measure Office Restaurant Retail Total 9W A19 63% 7% 90% 50% 8W BR30 - - 40% 40% Exit Sign LED 5% 8% 10% 6% 3.3.1.2 Verified Savings This section summarizes the verified impact results of the impact evaluation for the lighting measures. The Evaluators calculate adjusted savings as the difference in methodology application. This comparison verifies the difference in savings methodology alone, assuming 100% ISR and 100% electric water heat saturation. The Evaluators reviewed and applied the Idaho Power TRM v3.2 hours of use and heating and cooling interactive effect values for the lighting measures along with baseline assumptions agreed upon by Idaho Power to estimate savings per measure. Differences in the claimed savings and the adjusted savings arise from application of space heating and space cooling interactive effects. The verified savings the Evaluators calculated has used heating and cooling interactive effects sourced from the Idaho Power TRM v3.2 based on the facility type of the installed measure. The expected savings did not integrate interactive effects, and therefore display lower expected savings than verified adjusted savings. Additionally, for the retail facility type, IPC had calculated claimed savings using “Other” facility type hours of use (3,800 annual hours) for retail applications whereas the Evaluators estimated verified savings using a blended value of retail facility types (4,533 annual hours) from the TRM, excluding “Retail Big Box” and “Retail - 3-story Large”, as those facility types were unlikely to be included in the CSK program. These two differences in methodology led to greater than 100% realization rates for verified adjusted savings. The expected savings values used to determine the program-level realization rate were found by multiplying the savings per measure of the lighting measures included in kits by the total number of each measure sent out in kits during PY2021. The verified savings were determined by applying the ISR from the survey responses. Table 3-12 through Table 3-14 detail expected savings per lighting measure by facility type for both the ex-post and ex-ante. These tables detail savings with an assumed ISR of 100% to illustrate the difference in expected savings. The utilization of interactive effects in the verified savings calculations results in greater savings for all lighting measures. Therefore, the discrepancy resulting in low realization rates in verified savings (35%, as displayed in Table 3-10) stems solely from low ISRs. Table 3-12: Office Kit Adjusted Lighting Savings Facility Measure Expected Savings (100% ISR) Adjusted kWh Savings (100% ISR) Adjusted kWh Realization Rate (100% ISR) Office 9W A19 LED (One) 10.40 11.10 106.75% 9W A19 LED (Two) 10.40 11.10 106.75% Exit Sign LED (One) 66.58 93.51 140.46% Evaluation Report 26 Exit Sign LED (Two) 66.58 93.51 140.46% Total 153.95 209.23 135.91% Table 3-13: Restaurant Kit Adjusted Lighting Savings Facility Measure Expected Savings (100% ISR) Adjusted kWh Savings (100% ISR) Adjusted kWh Realization Rate (100% ISR) Restaurant 9W A19 LED (One) 19.60 20.58 105.00% 9W A19 LED (Two) 19.60 20.58 105.00% 9W A19 LED (Three) 19.60 20.58 105.00% Exit Sign LED (One) 66.58 91.98 138.16% Exit Sign LED (Two) 66.58 91.98 138.16% Total 191.95 245.70 128.00% Table 3-14: Retail Kit Adjusted Lighting Savings Facility Measure Expected Savings (100% ISR) Adjusted kWh Savings (100% ISR) Adjusted kWh Realization Rate (100% ISR) Retail 9W A19 LED (One) 15.20 19.31 127.04% 9W A19 LED (Two) 15.20 19.31 127.04% 8W BR30 LED (One) 102.60 130.35 127.04% 8W BR30 LED (Two) 102.60 130.35 127.04% Exit Sign LED (One) 66.58 93.29 140.13% Exit Sign LED (Two) 66.58 93.29 140.13% Total 368.75 485.90 131.77% 3.3.1.3 Non-Energy Benefits and Non-Energy Impacts As part of the evaluation, the Evaluators estimated NEBs and NEIs resulting from the lighting measures offered through the program. The Evaluators estimated NEBs using the Regional Technical Forum lighting workbook and the NEIs using the savings sources defined in Table 3-9. For the lighting measures, the Evaluators estimated annual NEBs, kW savings, and Therms penalty as defined in the IL TRM. The following tables display the total program NEB and NEI savings from each facility type. Evaluation Report 27 Table 3-15: Office Kit Lighting NEBs and NEIs Facility Measure Verified Annual NEBs ($) Verified kW Savings Verified Therms Savings Office 9W A19 $31.75 3.95 -264.16 8W BR30 N/A N/A N/A Exit Sign LED $0.00 1.56 -183.24 Total $31.75 5.51 -447.40 Table 3-16: Restaurant Kit Lighting NEBs and NEIs Facility Measure Verified Annual NEBs ($) Verified kW Savings Verified Therms Savings Restaurant 9W A19 $1.74 0.64 -23.07 8W BR30 N/A N/A N/A Exit Sign LED $0.00 0.79 -51.56 Total $1.74 1.43 -74.63 Table 3-17: Retail Kit Lighting NEBs and NEIs Facility Measure Verified Annual NEBs ($) Verified kW Savings Verified Therms Savings Retail 9W A19 $3.82 0.69 -65.73 8W BR30 $2.97 2.08 -197.20 Exit Sign LED $0.00 0.27 -35.29 Total $6.78 3.04 -298.21 The Evaluators applied the ISRs for each of the estimates above. The kits offered through the program displayed a total of $40.28 in annual NEBs, 4.88 kW savings, and 406.28 Therms penalty for the program. Table 3-18 Total Lighting Measure NEBs and NEIs Across Kits Verified Annual NEBs Verified kW Savings Verified Therms Savings $40.28 4.88 -406.28 3.3.2 Hot Water The Commercial Energy-Saving Kits Program provides a form of hot water measure in each of the three facility type kits. A bathroom and/or kitchen faucet aerator is included in each kit (1.0 GPM and 1.5 GPM, respectively). One pre-rinse spray valve is also included in each restaurant kit. Table 3-19 further defines the hot water measures included in the kits and savings source methodology utilized to evaluate energy savings for each measure. Evaluation Report 28 Table 3-19: Hot Water Measure Description Measure Description Savings Source Faucet Aerator (1 GPM) A low flow faucet aerator with a GPM of 1. Intended to be installed in a restroom. IL v9 TRM Section 4.3.2 Faucet Aerator (1.5 GPM) A low flow faucet aerator with a GPM of 1.5. Intended for use in the kitchen. IL v9 TRM Section 4.3.2 Pre-Rinse Spray Valve A pre-rinse spray valve to be installed in a commercial kitchen. RTF UES ComCookingPreRinseSprayValve_v2_5 Table 3-20 summarizes the verified electric energy savings for the hot water measures. Table 3-20: Hot Water Measures Verified Electric Savings Measure Facility Type Claimed Savings (kWh) Verified Savings (kWh) Realization Rate Bathroom Faucet Aerator (1 GPM) Office 20,598 11,080 53.79% Restaurant 53,170 25,601 48.15% Retail 1,494 2,689 180.00% Kitchen Faucet Aerator (1.5 GPM) Office 14,456 9,665 66.85% Restaurant 63,753 12,281 19.26% Pre-Rinse Spray Valve Restaurant 27,879 15,433 55.36% Total 181,350 76,749 42.32% The hot water measures displayed verified savings of 76,749 kWh with a realization rate of 42% compared to the claimed savings for these measures. The Evaluators summarize the measure-specific in- service rates and verified savings for the hot water measures in the sections below. 3.3.2.1 In-Service Rates This section describes the results of the verification surveys completed for the hot water measures. The Evaluators randomly selected a subset of participant customers to survey for simple verification of installed measure. Table 3-21 displays the resulting verified ISRs for each of the hot water measures of the program. Table 3-21: Hot Water Measures Verification Survey ISR Results Measure Office Restaurant Retail In-Service Rate Bathroom Faucet Aerator (1.0 GPM) 24% 45% 60% 31% Kitchen Faucet Aerator (1.5 GPM) 29% 15% - 24% Pre-Rinse Spray Valve - 55% - 55% 3.3.2.2 Verified Savings This section summarizes the verified impact results of the impact evaluation for the hot water measures. The Evaluators reviewed and applied the current RTF UES values for the pre-rinse spray valves and the IL v9 TRM for the faucet aerators along with surveyed ISRs to estimate program savings for these measures. The Evaluators employed the following sources to calculate verified savings for the measures: ◼ Bathroom faucet aerator: Illinois TRM Section 4.3.2 Evaluation Report 29 ◼ Kitchen faucet aerator: Illinois TRM Section 4.3.2 ◼ Pre-rinse spray valve: ComCookingPreRinseSprayValve_v2_5 The verified savings for the measure are 76,749 kWh with a realization rate of 42%, as displayed in Table 3-20. The expected savings used to determine the realization rate were found by multiplying the savings per measure of the hot water measures included in kits by the total number of each measure sent out in kits during PY2021. The verified savings were determined by applying the ISR from the survey responses. The following tables (Table 3-22 and Table 3-23 specify the expected and adjusted savings for each hot water measure per kit by facility type. These tables detail savings with an assumed ISR of 100% to illustrate the difference in expected and adjusted savings. The Evaluators found the expected savings assumptions for the bathroom, faucet aerators, and pre-rinse spray valves were appropriate and valid, and therefore did not apply adjustments to IPC expected savings for these measures. The Evaluators concluded that the adjusted RTF savings value of 321.78 kWh utilized by IPC to calculate pre-rinse spray valve savings was appropriate and therefore a 100% realization rate is also displayed for this measure. Table 3-22: Office Kit Adjusted Hot Water Savings Facility Measure Expected Savings (100% ISR, 100% Electric Water Heat Saturation) Adjusted kWh Savings (100% ISR, 100% Electric Water Heat Saturation) Adjusted kWh Realization Rate (100% ISR, 100% Electric Water Heat Saturation) Office Bathroom Faucet Aerator (1.0 GPM) (One) 64.34 64.34 100.00% Bathroom Faucet Aerator (1.0 GPM) (Two) 64.34 64.34 100.00% Kitchen Faucet Aerator (1.5 GPM) (One) 92.60 92.60 100.00% Total 221.29 221.29 100.00% Table 3-23: Restaurant Kit Adjusted Hot Water Savings Facility Measure Expected Savings (100% ISR, 100% Electric Water Heat Saturation) Adjusted kWh Savings (100% ISR, 100% Electric Water Heat Saturation) Adjusted kWh Realization Rate (100% ISR, 100% Electric Water Heat Saturation) Restaurant Bathroom Faucet Aerator (1.0 GPM) (One) 326.21 326.21 100.00% Bathroom Faucet Aerator (1.0 GPM) (Two) 326.21 326.21 100.00% Kitchen Faucet Aerator (1.5 GPM) (One) 469.47 469.47 100.00% Kitchen Faucet Aerator (1.5 GPM) (Two) 469.47 469.47 100.00% Pre-Rinse Spray Valve (One) 321.78 321.78 100.00% Total 1,913.14 1,913.14 100.00% Evaluation Report 30 Table 3-24: Retail Kit Adjusted Hot Water Savings Facility Measure Expected Savings (100% ISR, 100% Electric Water Heat Saturation) Adjusted kWh Savings (100% ISR, 100% Electric Water Heat Saturation) Adjusted kWh Realization Rate (100% ISR, 100% Electric Water Heat Saturation) Retail Bathroom Faucet Aerator (1.0 GPM) (One) 93.94 93.94 100.00% Total 93.94 93.94 100.00% The tables above display 100% realization rates between expected and adjusted savings, for the hot water measures. Therefore, the discrepancy in the verified savings realization rates (42%, displayed in Table 3-20) stem almost solely from the difference in assumed and verified ISRs and electric water heat saturation rates. 3.3.2.3 Non-Energy Benefits and Non-Energy Impacts As part of the evaluation, the Evaluators estimated NEIs resulting from the hot water measures offered through the program. There were no resulting NEBs for the hot water measures through the IL TRM. The Evaluators estimated the NEIs using the savings sources defined in Table 3-9. For the hot water measures, the Evaluators estimated secondary kWh savings, kW savings, and Therms savings as defined in the IL TRM. The following tables display the total program NEI savings from each facility type. Evaluation Report 31 Table 3-25: Office Kit Hot Water Measure NEIs Facility Measure Verified kW Savings Verified Therms Savings Verified Water Savings (Gallons) Office Bathroom Faucet Aerator (1.0 GPM) 0.00 0.87 352.34 Kitchen Faucet Aerator (1.5 GPM) 0.00 0.76 252.14 Pre-Rinse Spray Valve N/A N/A N/A Total 0.01 1.63 604.48 Table 3-26: Restaurant Kit Hot Water Measure NEIs Facility Measure Verified kW Savings Verified Therms Savings Verified Water Savings (Gallons) Restaurant Bathroom Faucet Aerator (1.0 GPM) 2.79 1,917.65 805,058.71 Kitchen Faucet Aerator (1.5 GPM) 1.34 920.15 316,856.95 Pre-Rinse Spray Valve 0.00 1,014.19 387,427.98 Total 4.13 3,852.00 1,509,343.63 Table 3-27: Retail Kit Hot Water Measure NEIs Facility Measure Verified kW Savings Verified Therms Savings Verified Water Savings (Gallons) Retail Bathroom Faucet Aerator (1.0 GPM) 0.32 134.26 37,576.62 Kitchen Faucet Aerator (1.5 GPM) N/A N/A N/A Pre-Rinse Spray Valve N/A N/A N/A Total 0.32 134.26 37,576.62 The Evaluators applied the ISRs for each of the estimates above. The kits offered through the program displayed a total of 4.46 kW savings and 3,987.89 Therms savings, and 1,547,524 gallons of water savings for the program. Table 3-28: Total Hot Water Measure NEIs Across Kits Verified kW Savings Verified Therms Savings Verified Water Savings (Gallons) 4.46 3,987.89 1,547,524.73 3.3.3 Advanced Power Strip The Commercial Saving Kits Program includes (1) advanced power strip in each of the office kits sent to participants. Table 3-29 further summarizes the measure. Evaluation Report 32 Table 3-29: Advanced Power Strip Measure Description Measure Description Impact Analysis Methodology Advanced Power Strip Advanced Power Strip which turns off power to equipment when not in use. RTF UES Table 3-30 summarizes the verified electric energy savings the advance power strip measure. Table 3-30: Advanced Power Strip Verified Electric Savings Measure Facility Claimed Savings (kWh) Verified Savings (kWh) Realization Rate Advanced Power Strip Office 38,473 26,100 67.84% Total 38,473 26,100 67.84% The advanced power strip measure displayed verified savings of 26,100 kWh with a realization rate of 68% compared to the claimed savings for the measure. The Evaluators summarize the in-service rate and verified savings for the advanced power strip measure in the sections below. 3.3.3.1 In-Service Rates This section describes the results of the verification surveys completed for this measure. Advanced power strips were provided in the office kits through the program. The restaurant and retail kits did not provide this measure. Participants who had received the advanced power strip in their kit were asked if the measure has been installed or if there were any plans to install the measure in the future. Table 3-21 displays the resulting ISRs for the advanced power strips. Table 3-31: Advanced Power Strip Verification Survey ISR Results Measure Office Restaurant Retail Total Advanced Power Strip 63% N/A N/A 63% 3.3.3.2 Verified Savings This section summarizes the verified impact results of the impact evaluation for the advanced power strip measure. The Evaluators reviewed and applied the current RTF UES values for the advanced power strip measure: ◼ ComAdvancedPowerStrips_v4-1 The verified savings for the measure is 26,100 kWh with a realization rate of 68%, as displayed in Table 3-30. The expected savings used to determine the realization rate were found by multiplying the savings per measure for advanced power strips included in kits by the total number of each measure sent out in kits during PY2021. The verified savings were determined by applying the ISR from the survey responses. The discrepancy between claimed and verified savings results from a difference in assumed and verified ISR. Evaluation Report 33 The table below details savings with an assumed ISR of 100% to illustrate the difference in expected and adjusted savings for the advanced power strip measure. For this measure, the Evaluators updated the expected savings to reference the value present in the RTF workbook for advanced power strips. Table 3-32: Office Kit Adjusted Savings Facility Measure Expected Savings (100% ISR) Adjusted kWh Savings (100% ISR) Adjusted kWh Realization Rate (100% ISR) Office Advanced Power Strip 64.80 65.00 100.31% Total 64.80 65.00 100.31% The table above display near-100% realization rate between expected and adjusted savings for the advanced power strip measure in the office kits. Therefore, the discrepancy in the verified savings realization rate stems almost solely from the difference in assumed and verified ISRs. 3.3.3.3 Non-Energy Benefits and Non-Energy Impacts As part of the evaluation, the Evaluators aimed to estimate NEBs and NEIs resulting from the advanced power strip measure offered through the program. However, there were no resulting NEBs or NEIs for the advanced power strips through the RTF. 3.4 Potential Unified Kit Results The Evaluators present the following findings to reflect how in-service rates and verified savings would be displayed if the measures provided in the facility-type kits were aggregated into one unified kit. The purpose of this review is to assist IPC with expected savings for the program going forward in which one unified kit will be delivered to participating small businesses, regardless of facility type. In this review, the Evaluators summarize findings for the following unified kit contents: Table 3-33: Potential Unified Kit Contents Measure End Use Units Included in Unified Kit 9W A19 Lighting 2 8W BR30 2 Exit Sign LED 1 Bathroom Faucet Aerator (1.0 GPM) Hot Water 1 Kitchen Faucet Aerator (1.5 GPM) 1 Because verified savings requires facility-dependent inputs, the expected savings per kit is calculated using facility-level assumptions on participation, electric water heat saturation, and in-service rates. The Evaluators summarize the assumed inputs in Table 3-34 and Table 3-35, which summarize participant responses from the program year 2021 impact surveys conducted by the Evaluator. Table 3-34: Assumed Facility-Level Participant Distribution Facility Type Weight of Participation Evaluation Report 34 Office 70% Restaurant 24% Retail 6% Table 3-35: Assumed Facility-Level Electric Water Heat Saturation Facility Type Electric Water Heat Saturation Office 56% Restaurant 40% Retail 90% Table: 3-36 summarizes the in-service rates displayed for the unified kit measure contents. The in- service rates are a blended rate summarizing the customer survey response installation rates for each business type and number of measures. Table: 3-36 Adjusted Measure Level In-Service Rates Based on Number of Units Measure End Use Units included in the kit Office Restaurant Retail 9W A19 Lighting 2 63% 10% 90% 8W BR30 2 40% 40% 40% Exit Sign LED 1 10% 15% 20% Bathroom Faucet Aerator (1.0 GPM) Hot Water 1 37% 70% 60% Kitchen Faucet Aerator (1.5 GPM) 1 29% 30% 29% Using the above assumptions on participation by facility type, ISR, and electric water heater saturation, the Evaluators estimate that a unified kit with the contents specified in Table 3-37 receive the following unadjusted and adjusted verified savings: Table 3-37: Unified Kit Expected Savings by Measure Measure End Use Units Included in Unified Kit Expected Unadjusted Savings (Assumed 100% ISR, 100% Electric Water Heat Saturation) Expected Adjusted Savings (Verified ISR and Electric Water Heat Saturation Applied) 9W A19 Lighting 2 27.73 12.75 8W BR30 2 187.86 75.14 Exit Sign LED 1 93.13 11.16 Bathroom Faucet Aerator (1.0 GPM) Hot Water 1 129.08 34.21 Kitchen Faucet Aerator (1.5 GPM) 1 184.56 26.00 Total - 622.36 159.26 The review of a unified kit resulted in 159 kWh verified savings per kit. This estimate assumes that facility-level participant distribution remains aligned with those displayed in program year 2021, and Evaluation Report 35 that in-service rates and electric water heat saturation rates are consistent with those displayed in program year 2021. 4. Process Evaluation Results The Evaluators completed a process evaluation for Idaho Power’s Commercial Energy-Saving Kits Program to gain a better understanding of customers’ experiences with the program. The process evaluation included interviews with the CSK program staff as well as customer surveys. The findings of the following sections summarize the results of those interviews and surveys. Interview results are included in Section 4.1 while survey results are included in Section 4.2. 4.1 Program Design and Operations Evaluators interviewed four Idaho Power Staff to learn more about the history, purpose, and design of the Commercial Energy-Saving Kits program. Interviewees included two analysts and two program specialists, all of whom are involved in the Commercial Energy-Saving Kits program. Idaho Power first launched the Commercial Savings Kit program in 2018 as a means of providing additional services to small businesses. The program was meant for smaller, mom-and-pop type businesses. During the initial roll out year, customers learned about and received the commercial savings kits in one of two ways: 1) as a leave behind item following a visit from Idaho Power field staff person, or 2) a call campaign marketing effort. Initially program staff had wanted to use the kits as a means of improving engagement with small businesses, offering them a chance to start a conversation with customers and tell them about the utility’s other offerings. Thus, the “leave behind” model had initially been the preferred distribution model. However, as the program progressed, staff found that “leave behind” model proved difficult from a tracking standpoint. Field staff were provided boxes of kits to distribute to customers and instructed on how to track which customers received kits; however, the tracking system was not streamlined and not all kits were properly accounted for. As the program entered its third year and COVID-19 emerged, much of the distribution moved to call center campaign. Although this method of distribution removed the personal touch and conversation starter of the field person visits, this model enabled Idaho Power staff to better track kit recipients. The Commercial Energy-Saving Kits program offered three different types of kits based on business type. Table 4-1 demonstrates the types of measures included in each kit. Staff determined which measures were included in the kits based on vendor recommendations and cost effectiveness of each measure. In addition to the energy efficiency measures, kits also included an educational component that provided customers with various tips and suggestions on how to save energy. Evaluation Report 36 Table 4-1: Kit Measures and quantities Measure Office Restaurant Retail 9W A19 LED 2 2 3 8W BR30 LED 0 2 0 LED Exit Sign 2 2 2 Bathroom Faucet Aerator (1.0 GPM) 2 1 2 Kitchen Faucet Aerator (1.5 GPM) 1 1 2 Pre-Rinse Spray Valve 0 0 1 Advanced Power Strip 1 0 0 Moving forward, Idaho Power plans to send one universal kit to all small business types. 4.2 Commercial Savings Kit Customer Survey Results Program participants were contacted via email to complete the survey. Idaho Power provided evaluators a list of 905 customers. Of those 905 customers, evaluators sent the survey to 600 unique participants. The remaining 305 customers did not receive a survey either because they did not have an email address on file, or they were a non-unique contact. Participants were contacted up to three times via email: one initial invitation and two follow-up reminders. 4.2.1 Survey Respondents In total, 98 recipients responded to the survey for a 16.3% response rate. The majority of respondents were offices, followed by restaurants, and retail stores (Table 4-2). Of those 98 respondents, 90 remembered receiving a kit and completed the survey. The eight respondents who did not remember receiving a kit were participants within the office facility type. Table 4-2: Respondent Type Facility Type Total Possible (n) Proportion of Total Respondents (n) Proportion of Respondents Office 432 72% 68 67% Restaurant 124 21% 20 22% Retail 44 7% 10 11% Total 600 100% 98 16.3% Less than two-thirds of respondents were the owner of the business (Figure ). Evaluation Report 37 Figure 4-1: Respondents' Role (n=90) The Evaluators found that 60% of responding businesses have gas heating (60.2%) (Figure 4-2) and more than half of responding business have electric water heating (56.1%) (Figure 4-3). Figure 4-2: Heating Fuel Type (n=90) 20.0% 20.0% 60.0% 10.0% 30.0% 60.0% 11.7% 1.7% 28.3% 58.3% 0.0%10.0%20.0%30.0%40.0%50.0%60.0%70.0% Other I don’t know Electric Gas Office Restaurant Retail Evaluation Report 38 Figure 4-3: Water Heater Fuel Type (n=90) 4.2.1.1 Program Satisfaction The vast majority of respondents were either satisfied or very satisfied with the Commercial Energy Saving Kits program (88.4%, n=76). Additionally, respondents were generally satisfied with the steps they had to take to receive the kit, as well as the items included in the kit (Figure 4-4). Among those respondents who expressed dissatisfaction with the kit, the primary complaint was that the measures were not useful to them and thus the kits felt wasteful. Figure 4-4: Program Satisfaction (n=86) Almost 80% of respondents found the installation guide helpful (78.9%, n=71). Remaining respondents noted that they did not need the guide because installation was easy or self-explanatory. Under two- thirds of respondents indicated that participation through the Commercial Energy-Saving Kits Program increased their satisfaction with Idaho Power as their utility provider (61.6%, n=53), and about half of respondents were interested in learning more about other energy efficiency opportunities through Idaho Power (51.6%, n=44). 90.0% 10.0% 5.0% 40.0% 55.0% 3.3% 8.3% 56.7% 31.7% 0.0%10.0%20.0%30.0%40.0%50.0%60.0%70.0%80.0%90.0%100.0% Other I don’t know Electric Gas Office Restaurant Retail Evaluation Report 39 4.2.1.2 Program Awareness Most respondents learned about the kits program through Idaho Power either via a mailing or bill insert (30%, n=27), email (24.4%, n=22), the Idaho Power website (21.1%, n=19), or a customer service representative (16.6%, n=14) (Figure ). Respondents indicated that email and mail/bill inserts are their preferred method of communication (Figure 4-6). Figure 4-5: Program Awareness (n=90) Figure 4-6: Preferred Awareness Method (n=90) 4.2.1.3 Program Participation The majority of respondents who remembered receiving a kit (n=90), indicated they installed some of the measures from the kit (95.6%, n=86). LED retrofit kits for exits signs were the most common item Evaluation Report 40 not installed by respondents, followed by pre-rinse spray valve, low-flow kitchen faucet aerators, and low-flow bathroom faucet aerators. Table 4-3: Number of respondents who did not install some/all of a measure Measure Possible respondents (n) Respondents who did not install (n) Respondents who did not install (%) LED general screw in bulbs 90 3 3.3% LED BR30 bulbs 10 3 30.0% Advanced power strip 60 5 8.3% Pre-rinse spray valve 20 9 45.0% Low-flow bathroom faucet aerators 90 36 40.0% Low-flow kitchen faucet aerator 90 36 40.0% LED retrofit kits for exit signs 90 62 68.9% Respondents were asked why they chose not to install all or some of each of the measures provided in the kit. In general, “I did not need the item”, “the item did not fit”, and “I have not had time to install the item” were the most popular reasons for not installing the exit signs, pre-rinse spray valve, and aerators (Figure ). LED general screw in bulbs and advanced power strips were not included in Figure 4-7 due to low number of no installs. Figure 4-7: Reasons for not installing Prior to receiving the kit, many respondents had purchased or planned to purchase a variety of energy efficient items (Figure 4-8). Table 4-4 demonstrates that the most popular reason respondents listed for not buying each of the measures prior to receiving the kit was because they did not know enough about the item. 13.9% 13.9% 11.1% 17.7% 19.4% 33.3% 44.4% 48.4% 25.0% 22.2% 33.3% 8.1% 0%10%20%30%40%50%60%70%80%90%100% Low-flow bathroom faucet aerators (n=36) Low-flow kitchen faucet aerator (n=36) Pre-rinse spray valve (n=9) LED retrofit kits for exit signs (n=62) Do not like the appearance of the item Have not had time to install I did not need the item Gave item to someone else Waiting for my current item to die The item did not fit I already had an energy efficient version of the item I took the item home I don't know Evaluation Report 41 Figure 4-8: Energy efficient items purchasing habits Table 4-4: Reasons why respondents did not previously purchase energy efficient items Measure Reason Proportion LED general screw in bulbs (n=27) Didn’t know enough about it 51.9% LED BR30 bulbs (n=5) Didn’t know enough about it/ Didn’t like the appearance 40.0% 40.0% Bathroom faucet aerator (n=78) Didn’t know enough about it 69.2% Kitchen faucet aerator (n=65) Didn’t know enough about it 67.7% Pre-rinse spray valve (n=10) Didn’t know enough about it 60.0% Advanced Power Strip (n=22) Didn’t know enough about it 59.1% LED exit signs (n=78) Didn’t know enough about it 76.9% When asked what additional items they would like to have received, respondents listed of variety of energy efficient items (Table 4-5). Among the items mentioned, occupancy sensors and timers for lights, air filters, smart thermostats, and weatherization measures were the only items listed that were not included in any of the kits. The Evaluators summarize the responses in the table below. Table 4-5: Requested Measures Measure n LED lights 17 Occupancy sensors/timers 9 Outdoor lighting 5 Advanced power strips 5 Weatherization 3 Solar measures 3 Air filters 1 Exit signs 1 Smart thermostat 1 Faucet aerator 1 Evaluation Report 42 5. Appendix A: Participant Survey This section provides a copy of the survey sent to participants of the Commercial Energy Saving Kits Program. 5.1 Pre-Defined Variables Prepopulated variables are shown in all caps enclosed in brackets, e.g., [PREDEFINED VARIABLE] Variable Definition CONTACT_NAME Premise Customer Name BUSINESS_TYPE Office=1; Restaurant=2; Retail=3 LOCATION Business Location 5.2 Email Survey Message Subject: Invitation to Help Improve Idaho Power’s Commercial Energy-Saving Kit Program Hello ${e://Field/CONTACT_NAME}, Thank you for participating in Idaho Power’s Commercial Energy-Saving Kit Program. Idaho Power is interested in your feedback about the program and invites you to take an online survey to let us know how we can improve it! The survey should take no more than 10 minutes of your time, and as a thank you we are providing a $25 gift card to the first 75 respondents who complete the survey. Follow this link to the Survey: ${l://SurveyLink?d=Take the Survey} Or copy and paste the URL below into your internet browser: ${l://SurveyURL} If you require technical assistance, please contact Tiffani Tonso at tiffani.tonso@admenergy.com. In addition, if you have any question regarding this survey request, please contact Idaho Power customer service at 208-388-2323 or 1-800-488-6151. You may also contact Chad Severson at Idaho Power at 208- 388-2398 or by email at cseverson@idahopower.com. Thank you so much for your time. Sincerely, Tiffani Tonso Evaluation Report 43 5.3 Survey Start of Block: Qualification Questions Q1 Our records indicate that your business located at ${e://Field/LOCATION} received a free energy saving kit from Idaho Power. This kit included measures like LED lighting, faucet aerators, and LED ‘Exit’ sign retrofit kit. Do you recall receiving this kit? o Yes (1) o No (2) Page Break Display This Question: If Our records indicate that your business located at ${e://Field/LOCATION} received a free energy s... = No Q2 Is there someone else in your business who may be able to answer questions about the kit? o Yes (1) o No (2) Page Break Display This Question: If Is there someone else in your business who may be able to answer questions about the kit? = No Q3 What is the main fuel type used for heating the building/facility? o Electric (1) o Gas (2) o Other, please specify: (3) __________________________________________________ o I don’t know (98) Evaluation Report 44 Display This Question: If Is there someone else in your business who may be able to answer questions about the kit? = No Q4 What is the main fuel type used for heating the building/facility's water? o Electric (1) o Gas (2) o Other, please specify: (3) __________________________________________________ o I don’t know (98) Display This Question: If Is there someone else in your business who may be able to answer questions about the kit? = Yes Q5 Can you provide me with their contact information? o Name (1) __________________________________________________ o Email (2) __________________________________________________ o Phone Number (3) __________________________________________________ End of Block: Qualification Questions Start of Block: Commercial Kit Program Awareness Q6 This first set of questions are about how you became aware of the Commercial Energy-Saving Kit Program. What is your job title or role? o Office Manager (1) o Store Manger (2) o Executive (3) o Assistant (4) o Food Service Staff (5) o Owner (6) o Other, please specify: (7) __________________________________________________ Evaluation Report 45 Page Break Q7 How did you learn about Commercial Energy-Saving Kit Program? (Please select all that apply.) ▢ Idaho Power customer service representative or energy advisor (1) ▢ Idaho Power website (2) ▢ Email from Idaho Power (3) ▢ Mailing/bill insert from Idaho Power (4) ▢ Contractor (5) ▢ Friends or colleagues (6) ▢ Internet search (e.g., Google) (7) ▢ Media advertisement (internet, radio, television) (8) ▢ Other, please specify: (9) __________________________________________________ ▢ ⊗I don’t know (98) Page Break Q8 What are the best ways to reach companies like yours with information about incentives for energy savings opportunities, like the ones offered through the Commercial Energy-Saving Kit Program? (Please select all that apply.) ▢ Visits from Idaho Power staff (1) ▢ Email (2) ▢ Mailings/bill inserts (3) ▢ Phone (4) ▢ Social media posts (5) ▢ Media advertisements (internet, radio, television) (6) ▢ Visits from contractors (7) ▢ Other, please specify: (8) __________________________________________________ Page Break Evaluation Report 46 Q9 The kit you received included an installation guide. Did you find the installation guide helpful? o Yes (1) o No (2) o Did not receive an installation guide (3) o I don’t know (98) Page Break Display This Question: If The kit you received included an installation guide. Did you find the installation guide helpful? = No Q10 What can Idaho Power do to improve the installation guide? _______________________________________________________________ End of Block: Commercial Kit Program Awareness Start of Block: Small Business Energy Kit Installation Q11 This set of questions asks you about the energy saving kit you received through Idaho Power’s Commercial Energy-Saving Kit Program. Were you able to install any of the items in the kit at your business located at ${e://Field/LOCATION}? o Yes (1) o No (2) Display This Question: If This set of questions asks you about the energy saving kit you received through Idaho Power’s Com... = No Q12 What were the reasons or circumstances that prevented you from installing the items in the kit at your business? ________________________________________________________________ End of Block: Small Business Energy Kit Installation Start of Block: Kit Install Evaluation Report 47 Q13 Below is a list of items that were included in your kit. Of these items how many did you install in your business? Display This Question: If BUSINESS_TYP = 1 Or BUSINESS_TYP = 3 Q14 How many of the (2) LED general purpose screw light bulbs did you install in your business? ▼ None (0) ... I don't know (98) Display This Question: If BUSINESS_TYP = 2 Q15 How many of the (3) LED general purpose screw light bulbs did you install in your business? ▼ None (0) ... I don't know (98) Display This Question: If BUSINESS_TYP = 3 16 How many of the (2) LED BR30 (flood lights) did you install in your business? ▼ None (0) ... I don't know (98) Display This Question: If BUSINESS_TYP = 1 Or BUSINESS_TYP = 2 Q17 How many of the (2) low flow bathroom faucet aerators did you install in your business? ▼ None (0) ... I don't know (98) Display This Question: If BUSINESS_TYP = 3 Q18 Did you install the (1) low flow bathroom faucet aerator in your business? ▼ Yes (1) ... I don't know (98) Evaluation Report 48 Display This Question: If BUSINESS_TYP = 1 Q19 Did you install the (1) low flow kitchen faucet aerator in your business? ▼ Yes (1) ... I don't know (98) Display This Question: If BUSINESS_TYP = 2 Q20 How many of the (2) low flow kitchen faucet aerator did you install in your business? ▼ None (0) ... I don't know (98) Display This Question: If BUSINESS_TYP = 2 Q21 Did you install the (1) pre-rinse spray valve in your business? ▼ Yes (1) ... I don't know (3) Display This Question: If BUSINESS_TYP = 1 Q22 Did you install the (1) advanced power strip in your business? ▼ Yes (1) ... I don't know (3) Q23 How many of the (2) LED retrofit kits for exit signs did you install in your business? ▼ None (0) ... I don't know (98) Evaluation Report 49 Display This Question: If How many of the (2) LED general purpose screw light bulbs did you install in your business? = None Or How many of the (3) LED general purpose screw light bulbs did you install in your business? = None Or How many of the (2) LED BR30 (flood lights) did you install in your business? = None Or How many of the (2) low flow bathroom faucet aerators did you install in your business? = None Or Did you install the (1) low flow bathroom faucet aerator in your business? = No Or Did you install the (1) low flow kitchen faucet aerator in your business? = No Or How many of the (2) low flow kitchen faucet aerator did you install in your business? = None Or Did you install the (1) pre-rinse spray valve in your business? = No Or Did you install the (1) advanced power strip in your business? = No Or How many of the (2) LED retrofit kits for exit signs did you install in your business? = None Q24 Why didn't you install the following energy saving items at your business? (Please select all that apply for each item. Use the right arrow next to the statement box to view Evaluation Report 50 additional items. Once all items have been answered, please click the right arrow at the bottom of the page to continue with the survey.) Display This Choice: If How many of the (2) LED general purpose screw light bulbs did you install in your business? = None Or How many of the (3) LED general purpose screw light bulbs did you install in your business? = None Display This Choice: If How many of the (2) LED BR30 (flood lights) did you install in your business? = None Display This Choice: If How many of the (2) low flow bathroom faucet aerators did you install in your business? = None Or Did you install the (1) low flow bathroom faucet aerator in your business? = No Display This Choice: If Did you install the (1) low flow kitchen faucet aerator in your business? = No Or How many of the (2) low flow kitchen faucet aerator did you install in your business? = None Display This Choice: If Did you install the (1) pre-rinse spray valve in your business? = No Display This Choice: If Did you install the (1) advanced power strip in your business? = No Display This Choice: If How many of the (2) LED retrofit kits for exit signs did you install in your business? = None Evaluation Report 51 Do not like the appearance of the item (1) Have not had time to install (2) Item was broken (3) I did not need the item (4) Gave item to someone else (5) Waiting for my current item to die (6) The item did not fit (7) I already had an energy efficient version of the item (8) I took the item home (9) I don't know (10) Display This Choice: If How many of the (2) LED general purpose screw light bulbs did you install in your business? = None Or How many of the (3) LED general purpose screw light bulbs did you install in your business? = None LED general screw in bulbs (1) o o o o o o o o o o Evaluation Report 52 Display This Choice: If How many of the (2) LED BR30 (flood lights) did you install in your business? = None LED BR30 bulbs (2) o o o o o o o o o o Display This Choice: If How many of the (2) low flow bathroom faucet aerators did you install in your business? = None Or Did you install the (1) low flow bathroom faucet aerator in your business? = No Low-flow bathroom faucet aerators (3) o o o o o o o o o o Evaluation Report 53 Display This Choice: If Did you install the (1) low flow kitchen faucet aerator in your business? = No Or How many of the (2) low flow kitchen faucet aerator did you install in your business? = None Low-flow kitchen faucet aerator (4) o o o o o o o o o o Display This Choice: If Did you install the (1) pre- rinse spray valve in your business? = No Pre-rinse spray valve (5) o o o o o o o o o o Evaluation Report 54 Display This Choice: If Did you install the (1) advanced power strip in your business? = No Advanced power strip (6) o o o o o o o o o o Display This Choice: If How many of the (2) LED retrofit kits for exit signs did you install in your business? = None LED retrofit kits for exit signs (7) o o o o o o o o o o End of Block: Kit Install Start of Block: Free Ridership Q25 The next set of questions asks you to think back to before you received the energy efficient items in your kit. Evaluation Report 55 Before you received your energy savings kit, had your organization purchased any of the following in the past… Display This Choice: If BUSINESS_TYP = 3 Display This Choice: If BUSINESS_TYP = 1 Or BUSINESS_TYP = 2 Display This Choice: If BUSINESS_TYP = 2 Display This Choice: If BUSINESS_TYP = 1 Yes (1) No (2) I don't know (98) LED general purpose screw in light bulbs (1) o o o Display This Choice: If BUSINESS_TYP = 3 LED BR30 flood lights (2) o o o Low-flow bathroom faucet aerators (3) o o o Display This Choice: If BUSINESS_TYP = 1 Or BUSINESS_TYP = 2 Low-flow kitchen faucet aerator (4) o o o Display This Choice: If BUSINESS_TYP = 2 Pre-rinse spray valve (5) o o o Display This Choice: If BUSINESS_TYP = 1 Advanced power strip (6) o o o LED retrofit kits for exit signs (7) o o o Evaluation Report 56 Q26 Before receiving your energy savings kit, did you have plans to purchase any… Display This Choice: If BUSINESS_TYP = 3 Display This Choice: If BUSINESS_TYP = 1 Or BUSINESS_TYP = 2 Display This Choice: If BUSINESS_TYP = 2 Display This Choice: If BUSINESS_TYP = 1 Yes (1) No (2) I don't know (98) LED general purpose screw in light bulbs (1) o o o Display This Choice: If BUSINESS_TYP = 3 LED BR30 flood lights (2) o o o Low-flow bathroom faucet aerators (3) o o o Display This Choice: If BUSINESS_TYP = 1 Or BUSINESS_TYP = 2 Low-flow kitchen faucet aerator (4) o o o Display This Choice: If BUSINESS_TYP = 2 Pre-rinse spray valve (5) o o o Display This Choice: If BUSINESS_TYP = 1 Advanced power strip (6) o o o LED retrofit kits for exit signs (7) o o o Evaluation Report 57 Page Break Display This Question: If The next set of questions asks you to think back to before you received the energy efficient item... = LED general purpose screw in light bulbs [ No ] Q27 Why have you not purchased ${Q25/ChoiceDescription/1} before? (Please select all that apply.) ▢ They cost too much (1) ▢ Didn’t know where to purchase ${Q25/ChoiceDescription/1} (2) ▢ Didn’t know enough about ${Q25/ChoiceDescription/1} (3) ▢ Don’t like their appearance or the quality of the ${Q25/ChoiceDescription/1} (4) Page Break Display This Question: If The next set of questions asks you to think back to before you received the energy efficient item... = LED BR30 flood lights [ No ] Q28 Why have you not purchased ${Q25/ChoiceDescription/2} before? (Please select all that apply.) ▢ They cost too much (1) ▢ Didn’t know where to purchase ${Q25/ChoiceDescription/2} (2) ▢ Didn’t know enough about ${Q25/ChoiceDescription/2} (3) ▢ Don’t like their appearance or the quality of the ${Q25/ChoiceDescription/2} (4) Page Break Evaluation Report 58 Display This Question: If The next set of questions asks you to think back to before you received the energy efficient item... = Low-flow bathroom faucet aerators [ No ] Q29 Why have you not purchased ${Q25/ChoiceDescription/3} before? (Please select all that apply.) ▢ They cost too much (1) ▢ Didn’t know where to purchase ${Q25/ChoiceDescription/3} (2) ▢ Didn’t know enough about ${Q25/ChoiceDescription/3} (3) ▢ Don’t like their appearance or the quality of the ${Q25/ChoiceDescription/3} (4) Display This Question: If The next set of questions asks you to think back to before you received the energy efficient item... = Low-flow kitchen faucet aerator [ No ] Q30 Why have you not purchased ${Q25/ChoiceDescription/4} before? (Please select all that apply.) ▢ They cost too much (1) ▢ Didn’t know where to purchase ${Q25/ChoiceDescription/4} (2) ▢ Didn’t know enough about ${Q25/ChoiceDescription/4} (3) ▢ Don’t like their appearance or the quality of the ${Q25/ChoiceDescription/4} (4) Page Break Display This Question: If The next set of questions asks you to think back to before you received the energy efficient item... = Pre-rinse spray valve [ No ] Q31 Why have you not purchased ${Q25/ChoiceDescription/5} before? (Please select all that apply.) ▢ They cost too much (1) ▢ Didn’t know where to purchase ${Q25/ChoiceDescription/5} (2) ▢ Didn’t know enough about ${Q25/ChoiceDescription/5} (3) ▢ Don’t like their appearance or the quality of the ${Q25/ChoiceDescription/5} (4) Page Break Evaluation Report 59 Display This Question: If The next set of questions asks you to think back to before you received the energy efficient item... = Advanced power strip [ No ] Q32 Why have you not purchased ${Q25/ChoiceDescription/6} before? (Please select all that apply.) ▢ They cost too much (1) ▢ Didn’t know where to purchase ${Q25/ChoiceDescription/6} (2) ▢ Didn’t know enough about ${Q25/ChoiceDescription/6} (3) ▢ Don’t like their appearance or the quality of the ${Q25/ChoiceDescription/6} (4) Page Break Display This Question: If The next set of questions asks you to think back to before you received the energy efficient item... = LED retrofit kits for exit signs [ No ] Q33 Why have you not purchased ${Q25/ChoiceDescription/7} before? (Please select all that apply.) ▢ They cost too much (1) ▢ Didn’t know where to purchase ${Q25/ChoiceDescription/7} (2) ▢ Didn’t know enough about ${Q25/ChoiceDescription/7} (3) ▢ Don’t like their appearance or the quality of the ${Q25/ChoiceDescription/7} (4) End of Block: Free Ridership Start of Block: Lost Opportunity Analysis Evaluation Report 60 Display This Question: If How many of the (2) LED general purpose screw light bulbs did you install in your business? = 2 Or How many of the (3) LED general purpose screw light bulbs did you install in your business? = 3 Or How many of the (2) LED BR30 (flood lights) did you install in your business? = 2 Or How many of the (2) low flow bathroom faucet aerators did you install in your business? = 2 Or Did you install the (1) low flow bathroom faucet aerator in your business? = Yes Or Did you install the (1) low flow kitchen faucet aerator in your business? = Yes Or How many of the (2) low flow kitchen faucet aerator did you install in your business? = 2 Or Did you install the (1) pre-rinse spray valve in your business? = Yes Or Did you install the (1) advanced power strip in your business? = Yes Or How many of the (2) LED retrofit kits for exit signs did you install in your business? = 2 Q34 The next set of questions asks you about additional measures you may have installed if more measures were provided. How many more of each would you have installed at ${e://Field/LOCATION}, if you were able to request more? (Please provide a numeric value.) Display This Choice: If How many of the (2) LED general purpose screw light bulbs did you install in your business? = 2 Or How many of the (3) LED general purpose screw light bulbs did you install in your business? = 3 Display This Choice: If How many of the (2) LED BR30 (flood lights) did you install in your business? = 2 Display This Choice: If How many of the (2) low flow bathroom faucet aerators did you install in your business? = 2 Or Did you install the (1) low flow bathroom faucet aerator in your business? = Yes Display This Choice: If Did you install the (1) low flow kitchen faucet aerator in your business? = Yes Or How many of the (2) low flow kitchen faucet aerator did you install in your business? = 2 Display This Choice: If Did you install the (1) pre-rinse spray valve in your business? = Yes Display This Choice: If Did you install the (1) advanced power strip in your business? = Yes Display This Choice: If How many of the (2) LED retrofit kits for exit signs did you install in your business? = 2 Evaluation Report 61 Additional Quantity (1) Display This Choice: If How many of the (2) LED general purpose screw light bulbs did you install in your business? = 2 Or How many of the (3) LED general purpose screw light bulbs did you install in your business? = 3 LED general purpose screw bulbs (1) ◼ Display This Choice: If How many of the (2) LED BR30 (flood lights) did you install in your business? = 2 LED BR30 flood lights (2) ◼ Display This Choice: If How many of the (2) low flow bathroom faucet aerators did you install in your business? = 2 Or Did you install the (1) low flow bathroom faucet aerator in your business? = Yes Low-flow bathroom faucet aerators (3) ◼ Display This Choice: If Did you install the (1) low flow kitchen faucet aerator in your business? = Yes Or How many of the (2) low flow kitchen faucet aerator did you install in your business? = 2 Low-flow kitchen faucet aerator (4) ◼ Evaluation Report 62 Display This Choice: If Did you install the (1) pre-rinse spray valve in your business? = Yes Pre-rinse spray valve (5) ◼ Display This Choice: If Did you install the (1) advanced power strip in your business? = Yes Advanced power strip (6) ◼ Display This Choice: If How many of the (2) LED retrofit kits for exit signs did you install in your business? = 2 LED retrofit kits for exit signs (7) ◼ Page Break Evaluation Report 63 Q35 Idaho Power is considering adding additional items to the kit and would like your opinion of useful items. Please list any energy efficient items that you would install at your business if they were included in an energy saving kit. ________________________________________________________________ End of Block: Lost Opportunity Analysis Start of Block: Kit Satisfaction Q36 The next set of questions asks you about your satisfaction with the Commercial Energy-Saving Kit Program and Idaho Power more generally. Please provide your satisfaction with each of the following: 1- Very dissatisfied (1) 2- Somewhat dissatisfied (2) 3- Neither satisfied nor dissatisfied (3) 4- Somewhat satisfied (4) 5- Very satisfied (5) I don't know (98) The types of energy efficient items you received in the kit (1) o o o o o o The steps you had to take to receive the kit (2) o o o o o o The Commercial Energy- Saving Kit program overall (3) o o o o o o Idaho Power as your utility provider (4) o o o o o o Evaluation Report 64 Page Break Display This Question: If The next set of questions asks you about your satisfaction with the Commercial Energy-Saving Kit... = The steps you had to take to receive the kit [ 1- Very dissatisfied ] Or The next set of questions asks you about your satisfaction with the Commercial Energy-Saving Kit... = The steps you had to take to receive the kit [ 2- Somewhat dissatisfied ] Or The next set of questions asks you about your satisfaction with the Commercial Energy-Saving Kit... = The Commercial Energy-Saving Kit program overall [ 1- Very dissatisfied ] Or The next set of questions asks you about your satisfaction with the Commercial Energy-Saving Kit... = The Commercial Energy-Saving Kit program overall [ 2- Somewhat dissatisfied ] Or The next set of questions asks you about your satisfaction with the Commercial Energy-Saving Kit... = Idaho Power as your utility provider [ 1- Very dissatisfied ] Or The next set of questions asks you about your satisfaction with the Commercial Energy-Saving Kit... = Idaho Power as your utility provider [ 2- Somewhat dissatisfied ] Q37 You indicated some dissatisfaction. Why were you dissatisfied? ________________________________________________________________ Page Break Display This Question: If The next set of questions asks you about your satisfaction with the Commercial Energy-Saving Kit... = The types of energy efficient items you received in the kit [ 1- Very dissatisfied ] Or The next set of questions asks you about your satisfaction with the Commercial Energy-Saving Kit... = The types of energy efficient items you received in the kit [ 2- Somewhat dissatisfied ] Q38 You indicated dissatisfaction with the energy efficient items included in your kit. What measures or changes to the measures would you like to see included? ________________________________________________________________ Page Break Evaluation Report 65 Q39 How has the receipt of your energy-saving kit affected your satisfaction with Idaho Power as your electrical provider? o Greatly increased your satisfaction (1) o Somewhat increased your satisfaction (2) o Did not affect your satisfaction (3) o Somewhat decreased your satisfaction (4) o Greatly decreased your satisfaction (5) o I don’t know (98) Q40 Would you like the Idaho Power team to contact you about other energy efficiency opportunities available for you and your business? o Yes (1) o No (2) Display This Question: If Would you like the Idaho Power team to contact you about other energy efficiency opportunities av... = Yes Q41 Please provide the name and contact information of the best person to contact about additional energy efficiency opportunities. o Name (1) __________________________________________________ o Title (2) __________________________________________________ o Phone Number (3) __________________________________________________ o Email (4) __________________________________________________ End of Block: Kit Satisfaction Start of Block: Fuel Type Evaluation Report 66 Q42 This final set of questions ask you about your business. What is the main fuel type used for heating the building/facility? o Electric (1) o Gas (2) o Other, please specify: (3) __________________________________________________ o I don’t know (98) Q43 What is the main fuel type used for heating the building/facility's water? o Electric (1) o Gas (2) o Other, please specify: (3) __________________________________________________ o I don’t know (98) End of Block: Fuel Type Start of Block: About Your Organization Q44 How would you describe your company’s facility located at ${e://Field/LOCATION}? o Your company’s only location (1) o One of several locations owned by your company (2) o The headquarter location of a company with several locations (3) o I don’t know (98) Page Break Evaluation Report 67 Display This Question: If How would you describe your company’s facility located at ${e://Field/LOCATION}? = One of several locations owned by your company Or How would you describe your company’s facility located at ${e://Field/LOCATION}? = The headquarter location of a company with several locations Q45 Did the company’s other locations also receive a Commercial Energy-Saving Kit from Idaho Power? o Yes (1) o No (2) o I don’t know (98) Page Break Q46 Does your company pay the electric bill for this location? o Yes (1) o No (2) o I don’t know (98) Page Break Q47 Do you have any other comments that you would like to relay to Idaho Power about energy efficiency in the commercial and industrial sector or about their programs? ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ Page Break Evaluation Report 68 Q48 We are interested in speaking with customers who installed measures from the kit using a video conference. To participate, you need to have a smart phone with access to the internet. In exchange, we are providing a $50 gift card for customers selected to participate in this additional research. This is in addition to the $25 gift card you will receive for completing this survey. Are you interested in participating in this research? o Yes (1) o No (2) Page Break Display This Question: If We are interested in speaking with customers who installed measures from the kit using a video co... = Yes Q49 Please provide the following information. If selected, we will contact you to arrange an appointment time. o Name (1) __________________________________________________ o Email (2) __________________________________________________ o Phone Number (3) __________________________________________________ o Best day(s) and time(s) to contact (4) __________________________________________________ End of Block: About Your Organization Start of Block: Gift Card Confirmation Q50 Thank you for taking the time today to complete this survey. As stated in the email, we are providing a $25 electronic gift card to the first 75 people who complete the survey as a thank you for a timely response. The email address we have on file for you is ${e://Field/EMAIL}. Please confirm this information: o Yes, please send my electronic gift card to the above email (1) o No, please send my electronic gift card to the following email (2) __________________________________________________ End of Block: Gift Card Confirmation Idaho Power Company Idaho Power Company Commercial and Industrial Energy Efficiency Program – New Construction 2021 Program Year Impact and Process Evaluation Results November 8, 2022 ii Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 6410 Enterprise Lane, Suite 300 | Madison, WI 53719 Tel 608-316-3700 | Fax 608-200-3278 tetratech.com © 2022 Tetra Tech, Inc. All Rights Reserved. iii Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 TABLE OF CONTENTS 1.0 EXECUTIVE SUMMARY ................................................................................................................. 1 1.1 Program Description .................................................................................................................. 1 1.2 Methodology .............................................................................................................................. 1 1.3 Findings and Recommendations ................................................................................................ 2 1.3.1 Impact Recommendations ................................................................................................. 2 1.3.2 Process Recommendations ............................................................................................... 3 2.0 INTRODUCTION ............................................................................................................................. 5 2.1 Program Overview ..................................................................................................................... 5 2.2 Evaluation Activities ................................................................................................................... 6 2.2.1 Evaluation Goals ............................................................................................................... 7 3.0 IMPACT EVALUATION ................................................................................................................... 9 3.1 Methodology .............................................................................................................................. 9 3.2 Impact Review Results ............................................................................................................. 11 3.2.1 Lighting............................................................................................................................ 13 3.2.2 HVAC .............................................................................................................................. 16 3.2.3 Controls ........................................................................................................................... 17 3.2.4 Compressed Air ............................................................................................................... 19 3.2.5 Building Shell .................................................................................................................. 19 3.2.6 Refrigeration .................................................................................................................... 20 3.2.7 Appliances with Electric Water Heating ........................................................................... 20 3.3 Review of PY2018 Impact Recommendations .......................................................................... 21 4.0 PROCESS EVALUATION ............................................................................................................. 22 4.1 Methodology ............................................................................................................................ 22 4.2 Process Review Results........................................................................................................... 22 4.2.1 Materials and Outreach Review ....................................................................................... 23 4.2.2 Contractor Interviews ....................................................................................................... 24 iv Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 LIST OF TABLES Table 1. PY2021 New Construction Offering Realization Rate ............................................................... 2 Table 2. PY2021 New Construction Offering Evaluation Activities ......................................................... 7 Table 3. PY2021 New Construction Offering Sampling Summary ........................................................ 10 Table 4. PY2021 Realization Rates for Measure Categories................................................................ 11 Table 5. PY2021 New Construction Lighting Impact Results Summary ............................................... 13 Table 6. PY2021 New Construction Air-Conditioning Impact Results Summary ................................... 16 Table 7. PY2021 New Construction Controls Impact Results Summary ............................................... 17 Table 8. PY2021 New Construction Compressed Air Impact Results Summary................................... 19 Table 9. PY2021 New Construction Building Shell Impact Results Summary ...................................... 19 Table 10. PY2021 New Construction Refrigeration Impact Results Summary ...................................... 20 Table 11. PY2021 New Construction Appliances Impact Results Summary ......................................... 20 Table 12. PY2018 CIEE New Construction Program Recommendations Review ................................. 21 LIST OF FIGURES Figure 1. Impact Evaluation Activities .................................................................................................... 1 Figure 2. Process Evaluation Activities .................................................................................................. 2 Figure 3. C&I New Construction Participants and Savings by Program Year Rules ............................... 6 Figure 4. Process for Verifying Program Savings ................................................................................... 9 Figure 5: Application Workbook—Controls Worksheet ......................................................................... 12 Figure 6. Process Evaluation Activities ................................................................................................ 22 v Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 ACKNOWLEDGEMENTS We would like to acknowledge the many individuals who contributed to the 2021 impact and process evaluation of the New Construction offering of the Idaho Power Commercial and Industrial Efficiency program. This evaluation effort would not have been possible without their help and support. We would like to specifically thank Sheree Willhite, Chad Severson, and Kathy Yi of Idaho Power, who provided invaluable insight into the Program and operations. These individuals participated in ongoing evaluation deliverable reviews and discussions and graciously responded to follow-up questions and data and documentation requests. Tetra Tech received valuable assistance from Idaho Power Energy Advisors with scheduling verification visits. The Tetra Tech Evaluation Team was made up of the following individuals: Kimberly Bakalars, Mark Bergum, Graham Thorbrogger, Nathan Kwan, Andrew Spista, and Laura Meyer. 1 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 1.0 EXECUTIVE SUMMARY Tetra Tech is pleased to provide Idaho Power Company (Idaho Power) with a report for the 2022 impact and process evaluation of the 2021 New Construction and Major Renovations (New Construction) offering of the Idaho Power Commercial and Industrial Energy Efficiency (CIEE) program. The Idaho Power CIEE program provides a comprehensive menu of incentives and services to facilitate the implementation of cost-effective energy-efficiency improvements for commercial and industrial (C&I) customers. Incentives cover retrofits, new construction and major renovation projects, and custom incentives for cost-effective projects not covered on the menu of incentives. This report section consists of (1) an introduction describing the program, (2) methodology, and (3) key findings and recommendations. The detailed impact results can be found in Section 3.0, with process results detailed in Section 4.0. 1.1 PROGRAM DESCRIPTION The New Construction offering provides incentives for designing and building better-than-code energy- efficient features into new construction, major renovation, addition, expansion, or change-of-space projects. The New Construction offering, which originated in 2004, currently offers a menu of 33 measures in Idaho and 25 measures in Oregon, including efficient lighting and lighting controls, cooling, ventilation, building shell, controls, appliances, refrigeration, office equipment, and compressed air projects. The program offers both customer and professional assistance incentives (PAI). Customer incentives are calculated based on eligibility criteria and applicable units for each specific measure; PAIs are available to architects and engineers for up to 20 percent of the participants' total incentive, with a maximum of $5,000 per application. Customers complete the Preliminary Application tab of the New Construction application if they are interested in receiving New Construction incentives. Idaho Power reviews each application and works with the customer and vendors to gather sufficient information. Qualification specifications are shared with the design team, and projects are completed. Then customers finish the New Construction application process by submitting all required documentation and emailing it to Idaho Power. Post- project verifications are conducted on ten percent of completed projects. 1.2 METHODOLOGY To address the evaluation objectives, which included verifying energy impacts attributable to the 2021 program, providing estimates of realization rates, and suggesting enhancements to the savings analysis and reporting, the evaluation team conducted the impact evaluation activities shown in Figure 1. Figure 1. Impact Evaluation Activities Tetra Tech also conducted a process evaluation for the New Construction offering; Figure 2 highlights the activities undertaken to address the process research objectives. Review data and conduct sampling Complete desk reviews Conduct site verification Verify kilowatt-hour savings 2 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 Figure 2. Process Evaluation Activities 1.3 FINDINGS AND RECOMMENDATIONS The process and impact evaluation for the New Construction offering of the CIEE program found a successfully run program that actively engages with the marketplace on new construction projects to impact the design and construction of new C&I facilities. The program stays current with code requirements and works with individual buildings to ensure they exceed code for the appropriate design and construction period. The program is historically heavily dependent on lighting, which will decrease as more projects in the pipeline update to IECC 2018 code. The evaluation team found that recommendations from the previous evaluation have been sufficiently addressed. We also found slight adjustments to ex-ante savings claimed in the PY2021 program and limited opportunities for process improvements. Because the Idaho Power staff delivering this program have developed good documentation and are continually pursuing improvements, we found the Program Engineer had identified and addressed many of the findings from this evaluation before the evaluation team presented them. In addition, Idaho Power is proactively making some of the adjustment options for PY2022 program implementation that were identified through the PY2021 evaluation. Overall, the impact evaluation found the program measures and savings are well supported and documented. The evaluation team determined that the realization rate is 102.5 percent for the PY2021 New Construction program. Table 1. PY2021 New Construction Offering Realization Rate Program year Number of projects MWh claimed MWh evaluated Program realization rate 2021 95 17,536 17,971 102.5% 1.3.1 Impact Recommendations The following impact recommendations are provided for Idaho Power's consideration: Document project worksheets at stages throughout the process. Documenting the project calculations and worksheets at three consistent stages will support project understanding. The evaluation team recommends that documentation is filed at three primary stages of the program process: (1) at preliminary application, (2) at final application, and (3) at final claimed savings. Documenting at these stages will make information available to understand project adjustment timing, purpose, and scale throughout the new construction process. Program staff interviews Materials and outreach review Contractor interviews 3 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 Increase program review and feedback of the submitted code-checking software, COMcheck. The COMcheck submittal, provided by the contractor, architect, or engineer, contains details about the claimed components of the design and determines if they meet or exceed the code. It is most commonly used for lighting calculations. The program staff currently completes a review of the proposed lighting equipment; still, an additional review of minimum code selections used to determine the calculation baseline will provide information to determine the consistency of applications to the program. The evaluation team recommends the information collected from the COMcheck review be used to engage with the contractors, architects, and engineers about preferred approaches for the program. Document the HVAC control systems that meet code and exceed code. Commercial HVAC systems are all designed based on the space requirements and can have systems that fit into one or more exemptions within the baseline code system. Understanding the baseline code and the exemptions in the context of determining what exceeds code can be complicated because some exemptions create a situation where a partial percentage of the installation total is required by code. Documenting the HVAC controls installed to meet code and those installed to exceed code will ensure the whole control system is documented and understood by all parties. Redesigning the HVAC controls and HVAC worksheets to document these values will support the program's quality assurance reviews. 1.3.2 Process Recommendations The New Construction offering of the CIEE program is operating well. Idaho Power staff have acted on previous recommendations to consolidate CIEE program information, and a couple of the current recommendations are an extension of that strategy. The following process recommendations are provided for Idaho Power's consideration: Continue to expand in-person outreach and program overview training where possible. Idaho Power has recently begun scheduling face-to-face meetings with architects and engineers after suspending them during the pandemic; our conversations with these firms confirm a real appetite for resuming those meetings. Although they understand why meetings were suspended, several respondents mentioned interest in getting back to the face-to-face meetings for the interaction they provide with Idaho Power staff and other firms. Small architect firms are particularly interested in training on program requirements and application processes that will make them more efficient. Consider developing a consolidated contractor list across CIEE programs with substantial overlap. The New Construction Program Engineer conducts numerous outreach activities with architects and engineers. However, firms we spoke with were often unclear on which CIEE program offering they were utilizing (New Construction, Retrofits, Custom) because it was usually more than one. A consolidated list of active contractors, architects, and engineering firms may help coordinate messaging to market actors, giving them more clarity as they work with customers. Maintaining a combined outreach list will also provide documentation in the event of staff changes and can assist with further managing outreach and engagement. Tracking could include flags for the type of market actor and latest event-date attendance and record notes on known relationships such as architect and engineer, engineer and subcontractor, etc. Consider a leave-behind brochure for contractors with all CIEE program offerings. There is substantial overlap in experience across programs among firms we interviewed. Idaho Power already enters contractor and design firm conversations with a CIEE overview and leaves appropriate program-specific information for them, depending on the firm's specialty. However, some of the firms we interviewed were concerned that there were customers they could not help with incentives. An overview 4 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 document may assist design firms with a way to explain program offerings and route customers to one that can benefit them the most. 5 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 2.0 INTRODUCTION 2.1 PROGRAM OVERVIEW The New Construction offering of the CIEE program provides incentives for designing and building better-than-code energy-efficient features into new construction, major renovation, addition, expansion, or change-of-space projects. The offering originated in 2004 and currently provides a menu of 33 measures in Idaho and 25 measures in Oregon, including efficient lighting and controls, cooling, ventilation, building shell, controls, appliances, refrigeration, office equipment, and compressed air projects. The program offers both customer and Professional Assistance incentives. Customer incentives are calculated based on eligibility criteria and applicable units for each specific measure; Professional Assistance incentives are available to architects and engineers for up to 20 percent of the participants' total incentive, with a maximum of $5,000 per application. Idaho Power's New Construction offering manual outlines all the incentives available and the steps to participate in the program. The Professional Assistance incentive increases the engagement with architects and engineers and is most beneficial to small- and medium-sized businesses that typically do not have staff with a technical background in construction, making it challenging to complete applications and submit documentation. Customers complete the Preliminary Application tab of the New Construction application if they are interested in receiving New Construction incentives. Idaho Power reviews each application and works with the customer and vendors to gather sufficient information. Qualification specifications are shared with the design team, and projects are completed. Then customers finish the New Construction application process by submitting all required documentation and emailing it to Idaho Power. Customer incentives •Specific to measure type and calculated by square foot, kilowatt-hour saved, cooling capacity, hp, unit, etc. •Eligibility requirements outlined in New Construction brochure Professional assistance incentives •20 percent of total participant incentive •Maximum of $5,000 per applicant •Increased from 10 percent and $2,500 maxin September 2020 Assess design for energy efficient opportunities•Discuss energy efficiency options with design team •Research requirements for incentive qualification Begin New Construction application •Download and complete preliminarytab •Email for Idaho Power review •Share qualification specifications with design team for the Professional Assistance incentive Complete project •Collect specification sheets •Collect proof-of-performance documentation Complete New Construction application •Attach documentation including invoices and proof of payment •Attach COMcheck if needed •Attach control strategy summary if needed •Email for Idaho Power review 6 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 Post-project verifications are conducted on 10 percent of completed projects. With COVID-19 restrictions in 2020, no on-site post-project verifications occurred. Instead, all documentation went through desk reviews. In 2021, on-site verification was completed on 13 percent of projects but found more discrepancies than in previous years. New Construction offering rolls out a new program format approximately every other year. Each format updates savings based on current code, conditions, and information captured in the Technical Reference Manual (TRM) at that time. When customers turn in a preliminary application, they are assigned the savings and incentives available under that program format for the project duration. Often new construction projects have long construction periods and require consistent and dependable incentives. Due to this, savings and incentives may be booked years later. The most recent 2021 format was rolled out on June 15, 2021, and captures the current code, costs, and savings in TRM Version 3. The 2021 format expanded the program offerings with ten new measures or additional offerings and adjusted existing measures to match the new code baseline. In 2021, the program completed 95 projects with total savings of 17,536 MWh. Most of the savings were generated using the 2018 version program rules, and only three percent of the savings used the 2021 version program rules. About 15 percent of the savings were attributed to projects using the 2016 program rules version. Figure 3. C&I New Construction Participants and Savings by Program Year Rules The program savings in PY2021 was over 90 percent lighting and controls. The categories of HVAC, building controls, and compressed air are the majority of the remaining savings with a limited number of measures installed in refrigeration, building shell, and appliances with hot water heating. This breakdown of savings is typical for a C&I New Construction program and identifies the risk to program savings as lighting code baselines increase efficiency, reducing lighting savings. 2.2 EVALUATION ACTIVITIES The evaluation activities conducted for New Construction offering projects are summarized in Table 2. Researchable issues are also discussed in this section. 20162,540 20166 201814,595 201879 2021402 202110 Savings(MWh) Participants 2016 2018 2021 7 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 Table 2. PY2021 New Construction Offering Evaluation Activities Activity Sample size Outcome Program delivery staff interview 1 Understood the program design and delivery and obtained program staff perspectives on program successes and challenges. Confirmed the researchable issues. Program delivery and marketing material review N/A Reviewed the marketing brochures, program manuals, outreach plans, and the program website for messaging and communication benefits. Tracking system review N/A Reviewed the tracking system to determine if all necessary inputs are tracked and if reporting tools contain sufficient information for program review. Desk reviews 17 Reviewed project documentation and calculations to assess the accuracy of savings claimed for each project. This included review of the energy savings calculations for conformance to the TRM for the version year identified. Verification on-site visits 7 Completed site visits to verify the installation of measures and assumptions in savings calculations. Verified that the locations matched projects that had a completed desk review. Architect and engineer interviews 9 Collected feedback from builders and design engineers working with the program, which included satisfaction and suggested improvements. 2.2.1 Evaluation Goals The impact and process evaluation goals below were outlined in the RFP; objectives were addressed through the evaluation activities listed above. Impact Evaluation • Review the tracking database to determine and verify the energy (kilowatt-hour) impacts attributable to the 2021 program. • Complete file reviews and verify engineering calculations with 90/10 (relative error of no more than 10 percent with 90 percent confidence) confidence and precision. • Provide credible and reliable program energy and non-energy impact estimates and ex-post realization rates for projects finalized in 2021. • Report findings and observations and provide recommendations that enhance the effectiveness of future ex-ante savings analyses and the accurate and transparent reporting of program savings. • Review the implemented changes in the 2021 version year. • Verify installation and operating conditions of equipment. • Review updated project verification standards developed by Idaho Power and the Integrated Design Lab (IDL) in 2022. Process Evaluation • Evaluate program design to ensure the use of industry best practices. 8 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 • Evaluate program implementation, including quality control, operational practice, and outreach. • Review program forms, manuals, and marketing materials, and provide recommendations for improvements as needed. • Evaluate program administration, including program oversight, staffing, management, training, documentation, and reporting. • Understand customer and contractor barriers to participation in the program and provide recommendations to increase participation. • Investigate how to best integrate the Custom Projects, New Construction, and Retrofits offerings. 9 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 3.0 IMPACT EVALUATION The following sections provide a detailed review of the impact evaluation methodology, evaluation results, and recommendations from the evaluation activities. 3.1 METHODOLOGY The impact methodology consisted of the four primary evaluation activities shown in Figure 4. Each activity is explained in more detail below. Figure 4. Process for Verifying Program Savings Review Data and Conduct Sampling The tracking system and documentation were provided to the evaluation team for review; the tracking data included information from Idaho Power and participants. The participants provided information through the Project Pre-Approval and Payment Applications for the New Construction offering. It included the following: • account information, including business name and account number, installation address, and contact information; • a project description; • estimated project costs and savings; • project timeline information (dates); and • payee information, if different from the account holder. Idaho Power logged this information and stored it in the program tracking database, CLRIS. In addition to the information above, the CLRIS database includes: • a customer ID; • the Idaho Power project representative and region; • customer rate class, building type, and owner occupant status; • version year and report year; • pre-application, final application, and inspected dates; • project type and area; • participant, architect, and applicable engineer contact information; • measure description and category type; and • gross kilowatt and kilowatt-hour savings and incentives per measure. Review data and conduct sampling Complete desk reviews Conduct site verification Verify kilowatt-hour savings 10 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 The documentation files provided for the New Construction offering showed both application submittal and the verification analysis with a post-installation final project review document. The files Idaho Power provided included: • the application, • engineering analysis and calculations, • verification report, • tracking system screenshot of project closeout, and • a post-installation project description. In addition to output from CLRIS and documentation files, Idaho Power program staff made the following supporting manuals available to the Tetra Tech team for review: • New Construction offering tracking database download for program year (PY) 2021; • Technical Reference Manuals (TRM) Versions 2.2, 3.0, 3.1, and 3.2; • Non-standard Lighting template; • New Construction marketing list from 2021; • C&I EE Programs Policy and Procedures Manual 2021 and 2022; and • New Construction Handbook 2022. Sampling was conducted at the project level with the stratum completed based on the program version year tracked on the project. The stratum was selected to ensure current implementation rules were evaluated as best as possible. The sampling is summarized in Table 3. Table 3. PY2021 New Construction Offering Sampling Summary Sampling stratum Total projects (total quantity) Program kWh savings percentage Sample projects (total quantity) Sample kWh savings percentage Version year 2021 10 2.29% 6 1.85% Version years 2018 and 2016 85 97.71% 11 40.39% Total 95 100.00% 17 42.24% The objective of the impact evaluation was to meet the precision requirement of 90/10 (relative error of no more than 10 percent with 90 percent confidence). The sample required one project to accomplish this, as the individual project savings was 30 percent of the total program savings. The remainder of the projects were randomly selected within the sampling stratum. The list of sampled projects was delivered to Idaho Power; individual project files were securely delivered to the evaluation team by an internet-based file-sharing site that required log-in access. The files delivered included: • applications and worksheets (administrative copies), • submitted project documents and emails, • equipment specifications, • post-install verification reports, and • incentive payment verification. 11 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 Complete Desk Reviews and Site Verifications Tetra Tech staff conducted desk reviews of the sampled project files. This engineering documentation review was conducted to describe the project, confirm tracking data, identify key assumptions, and determine critical questions before the site verification phase. The evaluation team reached out to the participants in the sample to schedule site visits in the first half of August 2022. Staff completed site visits by interviewing participants and verifying quantities, equipment specifications, and operating parameters. Verify Kilowatt-Hour Savings The final step of the impact evaluation combined information from desk reviews and site verifications to provide quality assurance for each reviewed project, describe any revisions to project assumptions and actual conditions, and update calculations to finalize evaluated savings. The data gathered from the site verifications was reconciled with the information from the initial desk reviews. Desk reviews and site verifications were completed for seven participants, and the remaining ten had only a desk review completed. 3.2 IMPACT REVIEW RESULTS Overall, the evaluation found that the New Construction offering had a realization rate of 102.5 percent with a relative precision of 2.20 percent at the 90 percent confidence interval. The overall and measure-category realization rates of the sample are shown in Table 4. Table 4. PY2021 Realization Rates for Measure Categories Measure category Ex-ante kWh Ex-post kWh Realization rate Lighting 6,692,449 6,882,603 102.8% HVAC 33,962 25,461 75.0% Controls 506,110 507,303 100.2% Compressed air 118,547 118,547 100.0% Building shell 28,002 28,002 100.0% Refrigeration 3,024 3,024 100.0% Appliances 5,561 5,561 100.0% Total 7,387,655 7,570,501 102.5% In addition to evaluating the savings claimed, available information, calculation protocols, and the program's quality assurance were reviewed. The Idaho Power New Construction & Major Renovations documentation is clear, and the application workbook is generally sufficient in providing clear direction and communication of project parameters from contractors to Idaho Power. However, on the HVAC Controls Worksheet, the worksheet has check boxes for different HVAC controls under the Energy Management Control Systems section for each type of HVAC system (see Figure 5 below). 12 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 Figure 5: Application Workbook—Controls Worksheet For a contractor or engineer opening this document at the end of the design, the workbook does not indicate the control system should be above the current code to be selected on the worksheet. Not including this language could result in the selection of all HVAC controls present in the system. Incentives and energy savings for HVAC controls are only eligible when controls are installed on equipment when Idaho's commercial energy code does not require it. Full and partial systems listed can be required by code in various situations. Documenting the installed system and capacity and the code-required systems and capacities in the application would provide transparency and consistency. However, the current practice of ensuring the supporting documentation includes the information meets the basic requirements to ensure program requirements are met. Following the application, the Idaho Power team reviews the package, opens a dialog with the applicant team to understand the details of the projects, and coordinates potential incentives. Some adjustments happen to the project applications and calculations throughout the project. The Idaho Power implementation team updated the calculations to ensure accurate energy savings; however, the evaluation team found that the adjustments were not logged or identified in the documentation. The Program Engineer noted that her email contains the justification and decision on adjustments after the initial application and that information is unavailable in the accessible documentation file. Projects may have long development periods between the initial application and completion; including this documentation in project files could support the staff's ability to recall past decisions on the project. The post-install verification report contained limited information about the critical items for energy efficiency but focused on the incentive. A post-install verification focusing on the details of the improvement and equipment installed would better support the program implementation. The primary reason for the realization rate exceeding 100 percent was that the old post-install verification report did not provide enough detail to identify an installation quantity deviation from the proposed plan. The program used a new verification report template in PY2022, which met the potential evaluation recommendation. The savings calculations were consistent and followed the TRM. Identifying the proper TRM and building code baseline did not always follow the tracking system information but was identified in the submitted documentation. The evaluation team agreed with the process for selecting the proper baseline code and TRM version, but consistent documentation would support clear tracking and calculation review. The baseline code and TRM version adjust for projects based on multiple conditions, so the program reporting year includes many variations of past TRMs and baseline codes. In particular, the previous versions of the TRM were unclear on the expected hours of use for lighting 13 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 and HVAC components. However, edits to the PY2021 TRM already coordinated and simplified the values to address this finding. The submitted code requirements require careful consideration by the program implementation staff. The components with the most variation are the lighting area determination, space type selection, and the HVAC controls required by the code. These determinations require judgment, and the applicant team may have a different level of judgment than the program implementation team. Tracking current assumptions in the COMcheck submittals will help the Program Engineer understand variations between submittals and support communication with contractors, architects, and engineers about current assumption selections. The evaluation team found that the confirmation of proposed or installed equipment was consistent. Although DLC is not required for some lighting measures if an engineer or architect specified and completed COMcheck, the evaluation team uses third-party verification of lighting fixture wattages such as Design Lights Consortium (DLC) resulting in several adjustments to project energy savings. In addition, the evaluation used the Air Conditioning, Heating, and Refrigeration Institute (AHRI) efficiency for HVAC units which also led to small adjustments in energy savings for projects. On one project, the evaluation found that the AHRI-rated efficiency disqualified the unit, significantly impacting the HVAC energy savings. 3.2.1 Lighting Lighting projects account for approximately 84 percent of the 2021 New Construction offering savings. The sample included 13 projects with lighting components, accounting for about 91 percent of the sampled kilowatt-hours. Five of the sampled projects included at least one other non-lighting project. Table 5 shows realization rates for each project, with the total realization rate for lighting savings claimed at 102.8 percent. Table 5. PY2021 New Construction Lighting Impact Results Summary Project ID Claimed kWh Evaluated kWh Realization rate 16166 1,114,881 1,227,151 110.1% 18238 3,499 4,734 135.3% 18289 40,016 41,231 103.0% 18311 82,546 84,563 102.4% 18315 16,604 15,136 91.2% 18365 74,313 76,029 102.3% 18458 5,324,012 5,400,102 101.4% 18541 1,391 1,391 100.0% 21006 10,974 5,048 44.5% 21014 3,423 3,593 105.0% 21050 5,197 6,081 117.0% 21051 5,197 5,381 103.5% 21078 10,396 12,163 117.0% Overall 6,692,449 6,882,603 102.8% 14 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 The lighting energy efficiency calculations were determined by identifying the code allowable lighting power density (LPD) and subtracting the installed lighting wattage. Evaluation adjustments from savings occurred for three primary reasons: 1. adjustment to the lighting area or space type in the LPD determination, 2. adjustment of the lighting quantity based on the evaluation site visits, and 3. adjustment of lighting fixture wattage based on third-party certification used by the evaluation team. The most significant risk to future program energy savings accuracy is the adjustments based on lighting area and space type for the LPD determination. However, the most significant adjustment to the impact evaluation results was the adjustment of the lighting quantity in a large agricultural facility. The Program Engineer has already implemented adjustments to the post-install inspection report template and training for site verifiers to address the evaluation findings in this area. Adjusting lighting fixtures to match third-party certifications ensures that the energy consumption is tested and verified for the lighting fixtures. In general, most lighting specification sheets are near the certified wattages, and savings adjustments are minor. However, there are cases where the adjustment can reach ten percent of the lighting savings on individual projects, such as Project ID 18315. The program should balance the implementation workload to determine certified wattages with the potential evaluation risk of not confirming the lighting wattage from the certification source. The evaluation did not recommend utilizing third-party certification for lighting because the conversation is ongoing across several programs implemented by Idaho Power. The descriptions below detail the evaluation findings for each lighting savings adjustment. Project ID 16166: The project involved installing DLC- and non-DLC-qualified fixtures for a new cold storage facility. An on-site visit was conducted for this location. We found that the number of fixtures within the office area was slightly lower than the quantity claimed. We also noted wattage adjustments for seven interior and four exterior fixtures. As a result, the energy savings slightly increased with a realization rate for lighting savings of 110 percent. Project ID 18238: A customer installed new DLC-qualified LED lighting troffers for a remodel. We found that the space-by-space method LPD baseline values were used rather than the building area method LPD baseline values which matched the area measured. We adjusted the baseline lighting power density (LPD) to match the 2015 International Energy Conservation Code (IECC) value for retail using the building area method, resulting in a significant energy savings increase. The realization rate is 135 percent. Project ID 18289: A customer building was built with DLC and ENERGY STAR-qualified fixtures. An on-site visit was conducted for this location. We found a slight increase in fixture quantity in the data room. We also noted a wattage adjustment for nine different interior fixtures. These changes led to a slight increase in energy savings. The resulting realization rate for lighting savings is 103 percent. Project ID 18311: A school was built with interior and exterior LED fixtures. Some of these fixtures were both non-DLC and non-ENERGY STAR-qualified. The interior lighting LPD was adjusted from 0.78 to 0.87 to match the value in IECC 2015 for a school/university. An on-site visit was conducted for this location. Fixture quantities were slightly increased based on the site visit. We also noted wattage adjustments for 19 fixtures, added a 1,100-foot exterior walkway to the calculation, and decreased the parking area. The resulting realization rate for lighting savings is 102 percent. 15 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 Project ID 18315: The project involved installing DLC-qualified interior LED fixtures in a significant renovation of a manufacturing facility. We made a significant wattage adjustment for the primary high bay fixtures, adjusting the fixture wattage from 128 W to 137 W based on the DLC-qualified listing for the product. Adjustments were also made for the smaller fixtures, changing one from 104 W to 107 W and the second from 26 W to 39 W. Overall, this increased the installed LPD and reduced energy savings. In addition, the hallway LPD was adjusted to match the IECC 2015 LPD for the space-by-space method. The resulting realization rate for lighting is 91 percent. Project ID 18365: This new project included LED fixtures. Some of the fixtures were not DLC- or ENERGY STAR-qualified. Three of the exterior fixtures had their wattages adjusted based on specification sheets. Sensors were found to be eligible based on IECC 2015 code. The resulting realization rate for interior and exterior lighting is 102 percent. Project ID 18458: This project involved installing DLC-qualified fixtures in a large unconditioned agricultural facility. The evaluation site visit identified 932 fixtures, reduced from 980 in the documentation. We also verified that the lighting was on at all hours and the building was exposed to exterior conditions; therefore, the interactive effects and coincidence factors were applied correctly. The resulting realization rate for lighting is 101 percent. Project ID 18541: The project included the installation of DLC-qualified fixtures for a new manufacturing facility. We found no discrepancies between the tracking system data and documentation. The realization rate is 100 percent. Project ID 21006: A new building was built with interior and exterior LED lighting. During the desk review and on-site verification visit, we subtracted approximately 500 linear feet of sidewalk in the public right-of-way and incorporated the lengths of the on-site walkways. The adjusted walkway area reduced the baseline LPD allowances, which reduced the exterior lighting savings to zero. Overall, the resulting realization rate is 44 percent. Project ID 21014: A major renovation to an office included new LED fixtures. During the evaluation, one LPD value for storage was adjusted based on the IECC 2015 (space-by-space method) value. The installed lighting wattage was also lowered based on a review of the installed fixtures. The combination of adjustments lowered the savings below the HVAC component of the project; therefore, the stacking effect further lowered the lighting savings. The coordinating HVAC impact increased energy savings. The resulting lighting realization rate is 105 percent. Project ID 21050: The project consisted of the installation of DLC- and non-DLC-qualified interior fixtures for an agricultural building. The evaluation identified that the baseline lighting code selected in COMcheck was incorrect; therefore, the LPDs were adjusted to match the IECC 2015 code. A slight wattage adjustment for two fixtures was also identified. The resulting realization rate for this project is 117 percent. Project ID 21051: The project consisted of DLC- and non-DLC-qualified interior and exterior fixtures for an agricultural building. The evaluation identified that the baseline lighting code selected in COMcheck was incorrect; therefore, the LPDs were adjusted to match the IECC 2015 code. Our verification site visit found that one of the high bay fixtures was missing and identified a slight wattage adjustment for two fixtures. The combination of the adjustments resulted in a 104 percent realization rate for lighting. Project ID 21078: The project consisted of installing DLC- and non-DLC-qualified interior fixtures for an agricultural building. We identified that the baseline lighting code selected in COMcheck was incorrect; therefore, the LPDs were adjusted to match the IECC 2015 code. The resulting realization rate is 117 percent. 16 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 3.2.1.1 Looking Forward—Lighting The evaluation tested the 2021 version year lighting projects to determine the impact of updating these projects immediately to IECC 2018 from IECC 2015. The IECC 2018 increases the baseline lighting efficiency, which reduces the allowable lighting wattage in the New Construction offering lighting calculations. The test found that the lighting savings decreased by approximately 20 percent. As projects are designed to IECC 2018 code, the program can expect a reduction in lighting savings claimed per project. Since the claimed projects will continue to have a mixture of baseline code in the designs and calculations, this reduction will not immediately be apparent in the program savings but will be noticeable at the project level, depending on the baseline code. 3.2.2 HVAC HVAC projects account for about five percent of the 2021 New Construction offering savings. The sample included five projects, which accounted for less than one percent of the total sampled energy savings. Table 6 shows the realization rate for the savings claimed is 43.3 percent. Table 6. PY2021 New Construction Air-Conditioning Impact Results Summary Project ID Claimed kWh Evaluated kWh Realization rate 16166 4,062 4,062 100.0% 18311 25,872 18,060 69.8% 18315 650 0 0.0% 18365 774 773 100.0% 21014 2,604 2,566 101.5% Overall 33,962 25,461 75.0% The HVAC category has two major adjustments, although because of the relative size of the savings to the whole program, the impact on the program was not as high. Each adjustment occurred for unique reasons; for one project, the HVAC units in the program's post-install verification could not be verified, and the evaluation removed the saving from the two small units from the project. The second project had an adjustment to the efficiency rating (SEER) of the installed units, adjustment of hours of use. The descriptions below detail the evaluation findings for each HVAC project savings adjustment. Project ID 16166: The project consisted of installing nine heat pumps at 5 tons or less and five split systems at 3 tons or less at a new cold storage facility. A site visit was completed for this project, and no discrepancies were found between the tracking system data, documentation, and site visit results. The realization rate for HVAC is 100 percent. 17 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 Project ID 18311: The project included the installation of 38 packaged systems at 5 tons or less, two packaged systems over 5 tons, four split systems below 5 tons, and economizers controlling over 190 cooling tons for an education facility. The SEER value for the 4YCZ6036 (3-ton) units was adjusted from 16.0 to 16.6; the SEER value for 4YCZ6060 (5-ton) units was adjusted from 16.0 to 15.1. The SEER of 15.1 does not qualify for incentives, and the 5-ton unit savings were reduced. The primary adjustment to energy savings was the reduction in cooling hours for the HVAC units for an education-primary school facility. The hours were adjusted from 700 to 203 based on Table 2-104 in TRM Volume 2.2. The savings calculation was adjusted to match the TRM by the evaluation team, although the Program Specialist acknowledged that alternate hours were used for this TRM version. In addition, the evaluation team removed an undocumented scaling factor included in the calculation spreadsheet. A second component of the savings was the airside economizer measure. The evaluation found the energy savings is acceptable, although several questions about the applicability of the code to the situation required conversations to determine. The combined adjustments resulted in a 75.0 percent realization rate for the HVAC. Project ID 18315: The HVAC portion of this project consisted of two split-system units at a remodeled manufacturing facility. The post-install verification report noted that the split systems were not located during the site visit. Our evaluation site visit could not be scheduled; the units were not verified as installed, and therefore, the evaluation removed their savings from the project. The HVAC savings were less than five percent of the total New Construction project claimed savings. The realization rate for the HVAC component measures is zero percent. Project ID 18365: The project consisted of a two-ton split system for a new hospital. We found no discrepancies between the tracking system data and documentation, but we were unable to confirm the model through the invoice. The resulting realization rate for this measure is 100 percent. Project ID 21014: The project consisted of a one-ton air-cooled heat pump and six water-cooled heat pumps for a remodeled office building. We found a slight cooling capacity adjustment for one water-cooled heat pump. The resulting realization rate is 101.5 percent for the HVAC component. 3.2.3 Controls Controls projects account for eight percent of the 2021 New Construction offering savings. The sample included six projects which accounted for seven percent of the sampled kilowatt-hours. Table 7 shows the realization rate for the savings claimed is slightly over 100 percent. Table 7. PY2021 New Construction Controls Impact Results Summary Project ID Claimed kWh Evaluated kWh Realization rate 18311 102,494 103,687 101.2% 18365 45,716 45,716 100.0% 18477 71,580 71,580 100.0% 21003 143,160 143,160 100.0% 21050 71,580 71,580 100.0% 21051 71,580 71,580 100.0% Overall 506,110 507,303 100.2% 18 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 The controls project in the sample were primarily variable frequency drives (VFD) installed on fans. We found no adjustments for these projects. However, the remaining project used multiple control strategies for an HVAC system coupled with a kitchen demand-controlled ventilation system. There were minimal adjustments to the project controls. The descriptions below detail the evaluation findings for each Controls savings adjustment. Project ID 18311: The project included installing an energy management system with three control strategies, a kitchen hood exhaust, and a VFD fan for a new school. An on-site visit was conducted for this location, although the strategies could not be verified by the site contact, and a reach-out to the remote-controls contact was not answered. The evaluation team found that the installed control system creates efficiencies above the code-required control system. The supply air temperature reset received an exemption because of the HVAC design and therefore was not required by code and remained a control strategy. The supply air temperature reset strategy was confirmed eligible based on the IECC 2015 exemption that did not require installation because of the limited mixing of HVAC air in the design. The demand control ventilation (DCV) strategy was confirmed eligible based on the IECC 2015 exemption that allows for facilities with 25 or fewer people per 1,000 square feet of space to operate without the controls required by code. For the kitchen hood VFD exhaust, it was found to have no discrepancies between the tracking system data and documentation. The resulting realization rate from removing one control strategy is 101 percent. Project ID 18365: This project consisted of nine 6 hp supply air fans installed with VFDs for a new hospital. There were no discrepancies between the tracking system data and documentation. The realization rate is 100 percent. Project ID 18477: This project included the installation of 60 hp of VFD fans for a new agricultural facility. There were no discrepancies between the tracking system data and documentation. The realization rate is 100 percent. Project ID 21003: This project included the installation of 120 hp of VFD fans for a new agricultural facility. There were no discrepancies between the tracking system data and documentation. The realization rate is 100 percent. Project ID 21050: This project included the installation of 60 hp of VFD fans for a new agricultural facility. There were no discrepancies between the tracking system data and documentation. The realization rate is 100 percent. Project ID 21051: This project included the installation of 60 hp of VFD fans for a new agricultural facility. There were no discrepancies between the tracking system data and documentation. The realization rate is 100 percent. 19 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 3.2.4 Compressed Air Compressed air projects account for about two percent of the total 2021 New Construction offering savings. The sample included two projects which accounted for less than one percent of the sampled kilowatt-hours. Table 8 shows the realization rate for each project. Table 8. PY2021 New Construction Compressed Air Impact Results Summary Project ID Claimed kWh Evaluated kWh Realization rate 18390 20,536 20,535.5 100.0% 18411 98,011 98,011 100.0% Overall 118,547 118,546.5 100.0% The descriptions below detail the evaluation findings; no adjustments were made for the compressed air measures. Project ID 18390: A manufacturing plant expanded operations with a new 20 hp air compressor with a VFD, and zero-loss condensate drains. No discrepancies were found between the tracking system data and documentation. The realization rate is 100 percent. Project ID 18411: A new manufacturing plant was built with a 100 hp air compressor with a VFD, and zero-loss condensate drains. No discrepancies were found between the tracking system data and documentation. The realization rate is 100 percent. 3.2.5 Building Shell Building shell projects account for less than one percent of total 2021 New Construction offering savings. The sample included two projects which accounted for less than one percent of the sampled kilowatt-hours. Table 9 shows the realization rate for each project. Table 9. PY2021 New Construction Building Shell Impact Results Summary Project ID Claimed kWh Evaluated kWh Realization rate 16166 26,648 26,648.45 100.0% 18365 1,354 1,353.882 100.0% Overall 28,002 28,002.33 100.0% The descriptions below detail the evaluation findings; no adjustments were made for the building shell measures. Project ID 16166: This project consists of the installation of a reflective roof for a new cold storage facility. No discrepancies were found between the tracking system data and documentation. The realization rate for this measure is 100 percent. Project ID 18365: This project consists of the installation of a reflective roof for a new hospital. No discrepancies were found between the tracking system data and documentation. The realization rate for this measure is 100 percent. 20 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 3.2.6 Refrigeration Refrigeration projects account for less than one percent of total 2021 New Construction offering savings. The sample included one project, accounting for less than one percent of the sampled kilowatt-hours. Table 10 shows the realization rate for the project. Table 10. PY2021 New Construction Refrigeration Impact Results Summary Project ID Claimed kWh Evaluated kWh Realization rate 18365 3,024 3,024 100.0% The description below details the evaluation findings. We made no adjustments to the Refrigeration measures. Project ID 18365: This project includes the installation of strip curtains for a walk-in cooler in a new hospital. We found no discrepancies between the tracking system data and documentation. The realization rate is 100 percent. 3.2.7 Appliances with Electric Water Heating Appliances projects for less than one percent of total 2021 New Construction offering savings. The sample included one project, accounting for less than one percent of the sampled kilowatt-hours. Table 11 shows the realization rate for the project. Table 11. PY2021 New Construction Appliances Impact Results Summary Project ID Claimed kWh Evaluated kWh Realization rate 18365 5,561 5,561 100.0% The description below details the evaluation findings. No adjustments were made to the appliance measures. Project ID 18365: This project includes the installation of an ENERGY STAR commercial dishwasher in a new hospital. No discrepancies were found between the tracking system data and documentation. The realization rate is 100 percent. 21 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 3.3 REVIEW OF PY2018 IMPACT RECOMMENDATIONS As part of the impact evaluation, Tetra Tech reviewed Idaho Power's progress against the recommendations made during the last impact evaluation of the 2018 program. The table below highlights Idaho Power's actions to address the previous impact recommendations. Table 12. PY2018 CIEE New Construction Program Recommendations Review Category Key finding and recommendation PY2021 implementation Status Calculations Utilize hours of use from the TRM for lighting and HVAC projects that started after the TRM was implemented. Idaho Power updated TRM 3.0 to simplify and coordinate HVAC hours of use. However, the projects claimed in PY2021 are generally using previous versions and therefore are not using the updated hours of use. The lighting hours of use are custom-entered for interior lighting and TRM-based for exterior lighting. In progress Tracking system Tracking data should include the version of the TRM utilized for each project. The tracking data includes an identification of the TRM version in use for calculating the claimed savings. Complete 22 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 4.0 PROCESS EVALUATION The following sections provide a detailed review of the process evaluation methodology, evaluation results, and recommendations from the evaluation activities. 4.1 METHODOLOGY The process methodology consisted of three primary evaluation activities shown in Figure 6. Each activity is explained below. Figure 6. Process Evaluation Activities Program Staff Interviews Idaho Power staff responsible for the program delivery provided Tetra Tech staff with an overview of the program design, objectives, staffing, outreach, procedures, tracking, and achievements. Idaho Power program staff also responded to evaluation questions and provided requested materials. Materials and Outreach Review Tetra Tech read the Idaho Power Commercial and Industrial Energy Efficiency Policies and Procedures Manual dated January 2021. The program logic model developed in 2018 was also reviewed for the entire Commercial and Industrial Energy Efficiency (CIEE) program at the time, including Retrofits, New Construction, and Custom Projects offerings. Tetra Tech explored the Idaho Power website for energy efficiency information for businesses and any linked documentation, including applications and instructions. Idaho Power staff also provided an overarching CIEE slide deck and general CIEE brochure to facilitate discussions with customers and contractors regarding all of the CIEE offerings from Idaho Power. A program-specific New Construction brochure was also reviewed, which details the incentives and requirements for the New Construction program. Contractor Interviews C&I customers work with architects and engineers to design energy-efficient buildings that qualify for Idaho Power New Construction offering incentives. The Program Engineer provided a list of firms and contacts associated with projects in 2021. Tetra Tech sampled 30 companies; all architects and engineers with email addresses were emailed and followed up with via telephone to complete interviews with nine firms that could provide feedback on the New Construction offering incentives. 4.2 PROCESS REVIEW RESULTS Idaho Power follows program management best practices with a program manual and logic model developed for the CIEE suite of programs. Communication between Idaho Power, architects, and engineers is working well, and engineers find the application process straightforward and easy to complete for their customers. Program staff interview Materials and outreach review Contractor interviews 23 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 4.2.1 Materials and Outreach Review Policies and Procedures Manual Tetra Tech reviewed the 2020 and 2021 versions of the Idaho Power Commercial and Industrial Energy Efficiency Policies and Procedures Manual. The 2020 version was updated through November 2019, and the 2021 version was updated in January 2021. Edits to the manual included slight customer eligibility changes and equipment adjustments. The program manual includes a good overview of all CIEE offerings from Idaho Power. In addition, it offers sufficient detail for each major offering (Custom Projects, Retrofits, and New Construction), such as pre-approval and payment application processes and inspection requirements. Other commercial offerings, including Energy Assessments, Energy-Saving Kits, Flex Peak, Green Rewind, and Technical Training, are briefly described for the reader. The Idaho Power contact information and revision history sections are also beneficial to both internal utility and external partner and customer users. Other resources listed include approximately 25 organizations like ASHRAE, ENERGY STAR®, and Integrated Design Labs. The primary program manual sections include the following: 1. Program Overview - including eligibility requirements 2. Program Offerings - Retrofits, New Construction, Custom Projects, Additional Offerings 3. Steps to Participate - Lighting retrofits, Non-lighting retrofits, New Construction 4. Custom Projects - steps to participate 5. Energy Efficient Assessments 6. Inspections, Measurement and Verification 7. False Information 8. Pre-Approval 9. Satisfaction of Customers 10. Program Staff Contact Information 11. Commercial & Industrial Energy Efficiency Program Terms and Conditions 12. Other Resources 13. Review and Revision History Logic Model Our review of the CIEE logic model, developed in 2018 in response to a previous evaluation recommendation, shows that the New Construction offering closely follows the program design and delivery steps laid out in the logic model. The major steps—(1) Idaho Power outreach, (2) customer submission of preliminary application, (3) customer implementation, and (4) customer submission of final application—are all in line with the current program delivery as outlined in the program policies and procedures manual. In addition, the short- and long-term outcomes of the New Construction offering are being realized. 24 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 Outreach Idaho Power continues to market the New Construction offering in conjunction with all CIEE offerings. Methods such as bill inserts, newsletters, airport advertising, radio, and social media messages communicate the benefits businesses can realize through Idaho Power's energy efficiency programs. In addition, there were a few outreach options specific to New Construction: • The summer newsletter issue, sent to 13,971 customers in June 2021, focused on incentive changes for Retrofit and New Construction offerings. It also included a Simplot success story and promotion of the GMI. • Idaho Power sponsored the virtual BOMA Commercial Real Estate Symposium on February 18, 2021. During the event, Idaho Power shared a video from the New Construction Senior Engineer that included the Idaho Humane Society success-story video. The company also developed slides with key company facts that rotated on the screen before the event, placed LEDs and a brochure in the event giveaway box that was available for pickup, and placed an ad and article in the event program. In March, the company also participated in BOMA's virtual Thursday Conversations video blog. • Idaho Power representatives conducted conversations via telephone and email with architectural and engineering firms in Boise; in-person visits were not allowed in 2021 due to COVID-19 restrictions. The conversations helped build relationships with the local design community. The Idaho Power website was explored for energy efficiency information for businesses and any linked documentation, including applications and instructions. The selection of state and then New Construction information was easy to follow. Since most of the initial marketing and outreach are done as an overarching CIEE program, Idaho Power staff provided the overarching CIEE slide deck and general CIEE brochure that staff use to facilitate discussions with customers and contractors regarding all the CIEE offerings from Idaho Power. A program-specific New Construction offering brochure was also reviewed, which details the incentives and requirements for the New Construction offering of the CIEE program. All slides and brochures are visually appealing and provide good information on what is offered through the CIEE program. The New Construction offering brochure provides the specific information needed for customers or design firms interested in applying for New Construction offering incentives. 4.2.2 Contractor Interviews A mix of thirty architecture and engineering firms were contacted from a list provided by Idaho Power; interviews were completed with nine firms in August 2022. Five of our discussions were with architects, and four were with engineering firms; all provide design services for C&I customers with little residential work. The firms we spoke with have all been working with Idaho Power programs for several years. At least five of the firms also completed projects that qualified for another Idaho Power CIEE program, such as Retrofit or Custom Projects. 25 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 Communication Both architects and engineers reported having a good relationship or support from Idaho Power staff. Emailed information has been sufficient for most firms to remain updated on program requirements. Two of the firms mentioned direct contact with the Program Engineer if they have questions, and one thought the presentation they attended was helpful. Two of the smaller architecture firms would like more in-person contact with Idaho Power staff to better understand the New Construction offering. How firms handle discussions with customers about energy-efficient projects varies by firm. Two of the architecture firms leave the responsibility for the discussion to the engineers; one of the architects talks to their customers early in the design about energy efficiency; one large firm is working to increase awareness among their internal staff of Idaho Power offerings to better serve their customers. However, as Idaho Power is aware, a common barrier to many discussions is customer preference for aesthetics over mechanical efficiency. Architecture and design firms that help customers meet the New Construction offering incentive requirements are eligible for a Professional Assistance incentive. Two of the firms we spoke with were not aware of the incentive; four firms were aware of the incentive, with two using it heavily and two others that were happy with it but did not find it critical to encouraging customers to build above code. One respondent mentioned the recent increase in the incentive and said that it was providing additional motivation for their internal staff to work with customers on eligible designs. Applications Projects incentivized through the New Construction offering are required to fill out a preliminary application that is reviewed by Idaho Power or IDL. At that point, the customer is assisted with any preliminary calculations and is assigned a project number. Opportunities that qualify for Custom Projects are identified for the customer. Once a project is completed, a final application is submitted. At least seven of the firms we spoke with complete applications for customers, although two of the architects do so through the engineers working with them. Six of the respondents volunteered how easy the process is to complete applications for Idaho Power. Although the process is easy, it does take a certain amount of time. A couple of the firms are grateful for the Professional Assistance incentive for that reason. “It is easy, we plug in the information. It is nice and straightforward.” In most cases, the program incentive is paid to the customer. Only in a few instances will the customer request the incentive be paid to the architect or engineer. 26 Idaho Power CIEE New Construction – 2021 Evaluation Results. November 8, 2022 Satisfaction Overall, architecture and engineering firms are satisfied with the New Construction offering; they feel it provides good service and support, benefitting the C&I customers they serve. Just one respondent provided a neutral response, mostly due to a lack of interaction with the program. Four of the respondents we spoke with were familiar with the meetings and training provided by Idaho Power and IDL; they found those meetings to be useful and a good source of information and interaction. Three firms were not aware of meetings or training. All the firms felt it would be good to continue meetings to discuss program requirements and get new, small firms up to speed. The firms we spoke with had few suggestions for improving the New Construction offering. One mentioned improving options for enrolling in major rehabilitation projects and opportunities for office buildings. Another suggested an easy-to-read guide for the customer that the architects or engineers could present early in their customer discussions. COVID-19 At least three of the firms we spoke with thought they were busier during COVID-19 than before the pandemic; however, at least six firms mentioned supply chain delays and complications with project scheduling. One said the pandemic created more flexibility in how they do business. Interestingly, two firms have noticed changes in customer requests, including better filtration and airflow and more touchless technology and sensors. Supplement 2: Evaluation Demand-Side Management 2022 Annual Report Page 447 OTHER REPORTS Report Title Sector Analysis Performed By Study Manager Study/Evaluation Type 2022 A/C Cool Credit Program End-of- Season Report Residential Idaho Power Idaho Power Other 2022 Flex Peak Program End-of-Season Annual Report Commercial/Industrial Idaho Power Idaho Power Other 2022 Irrigation Peak Rewards Program Report Irrigation Idaho Power Idaho Power Other Historical DSM Expense and Performance, 2002–2022 Residential, Commercial/Industrial, Irrigation Idaho Power Idaho Power Other Student Energy Efficiency Kit Program— School Year 2021–2022 Annual Report Residential Tinker LLC Tinker LLC Other Home Energy Reports Summary Residential Harris Utility Consumer Analytics Harris Utility Consumer Analytics Other Idaho Power Company Demand Response Potential Assessment Report (online) Residential, Commercial/Industrial, Irrigation AEG AEG Other Idaho Power Company Energy Efficiency Potential Study (online)* Residential, Commercial/Industrial, Irrigation AEG AEG Other * Titles appearing in blue are links to the online versions of the reports. Supplement 2: Evaluation Page 448 Demand-Side Management 2022 Annual Report 1 A/C Cool Credit - 2022 Results Table of Contents Summary ............................................................................................................................................................... 1 Program Overview ............................................................................................................................................. 2 Methodology ....................................................................................................................................................... 3 Baseline Usage Calculation ......................................................................................................................... 3 Non-Contributing Households ................................................................................................................... 4 Results ................................................................................................................................................................... 4 Tables ................................................................................................................................................................ 5 Charts ................................................................................................................................................................ 7 Summary This report presents an analysis of the demand response events called by Idaho Power’s A/C Cool Credit program during the summer of 2022. The program called a total of 13 demand response events that included 19,127 households. The peak realized reduction at the generator level during this period occurred on July 29th, with a reduction of 1.05 kW per participant and a total system curtailment of 20.1 MW. In comparison, the maximum potential reduction for the season is estimated to be 26.8 MW, based on a generator level reduction of 1.4 kW per participant at a cycling rate of 65%. Table 1. Season Summary Results Region Participant Count Peak Realized Curtailment Peak Potential Curtailment Idaho 18,910 19.9 MW 26.5 MW Oregon 217 0.2 MW 0.3 MW Total 19,127 20.1 MW 26.8 MW 2 Program Overview The A/C Cool Credit program underwent several operational changes in 2022. Most notably, the end of the cycling season was extended by one month, from August 15th to September 15th. This program change allowed the program to operate on multiple high-temperature days in early September that previously would have been ineligible for demand response. Figure 1 provides an overview of important dates in the 2022 cycling season. Program event guidelines allow for event duration of up to four hours. However, events in the last several years of the program have generally lasted only three hours. In 2022, the program began incorporating longer event spans: eight out of the 13 events called this season spanned four hours. Additionally, Idaho Power enacted a more flexible approach to event cycling rates. In 2020, all events were cycled at 50%, meaning participating A/C units were switched off for approximately 30 minutes out of an hour. In 2021, the cycling rate was set at 55%. This season, the cycling rate was dynamically selected based on the circumstances of each demand response event. Five of the events in 2022 were cycled at 55%, with the other eight cycled at 50%. Overall, the changes made to the program in 2022 have significantly improved its potential effectiveness for Idaho Power. The extension of the cycling season and incorporation of longer event spans have allowed the program to respond to a wider range of high-temperature days and better meet system needs. The more flexible approach to cycling rates has also given the program greater control over the size and timing of demand reductions, ensuring that it can effectively reduce energy demand while still maintaining participant comfort. These operational changes make the program a more reliable and effective tool for managing energy demand and helping to reduce strain on the power grid. Figure 1. 2022 Season Dates 3 Methodology Idaho Power continues to calculate A/C Cool Credit program savings using the evaluation methodology created by ADM Associates as part of the 2021 impact evaluation. This methodology models demand reductions by using a variety of statistical methods to determine each participant’s hypothetical usage as if there had not been a demand response event that day. Additionally, the methodology evaluates the number of households who did not contribute a statistically significant demand reduction to each event. This section provides an overview of the model steps; a more detailed discussion can be found in ADM’s 2021 program impact evaluation in Supplement 2 of Idaho Power’s 2021 Demand-Side Management Annual Report. Baseline Usage Calculation To model participant energy usage at the household level, the evaluation methodology requires four primary data inputs: a list of participating demand response switches, hourly meter reads for all participants for the cycling season, hourly weather reads for the service territory, and the date and time of all demand response events. By integrating these inputs, the methodology takes into account the unique energy usage patterns of each household. Since each household is unique and may exhibit vastly different energy usage patterns, there is no single statistical model that will perfectly fit every participant. Instead, the methodology tests five possible models to find the best fit for each household. These models fall into two categories: 1. A weather-adjusted Linear Fixed Effect Regression (LFER) model. This is a regression model that controls for variables including Cooling Degree Days, Heating Degree Days, and hour of the day, and treats each household as an individual fixed effect. 2. A Customer Baseline (CBL) model tuned with various eligibility periods and offset methods. The possible eligibility periods are 3-of-5 and 3-of-10, the latter of which would mean that the model looks at the three highest usage days of the last 10 eligible days. The offset factor determines how the model scales usage based on usage prior to the event start. The possible methods are additive and multiplicative. Model performance was assessed based on how well the model predicted the household’s energy consumption across four proxy days. These days were chosen because they were the hottest days of the season that were not affected by any events. The data used to train the household models did not include energy usage during these proxy days or event days. In both 2021 and 2022, the LFER model was the best fit for the largest number of participants. The final reported savings are derived from a mixed model, which incorporates household level results based on the best fit of the five models for each participant. This approach ensures that baseline estimates are robust to variance in household behavior. 4 Non-Contributing Households A separate calculation within the model provides an estimate of Non-Contributing Households (NCH), or the number of households during each event that did not produce a statistically noticeable demand reduction. This is an important metric for understanding overall impacts of demand response efforts and for identifying characteristics of event days and households that may prompt non-responsiveness. Importantly, NCH is calculated for informational purposes and is ultimately independent of overall savings results, which include all program participants whether responsive or not. In some cases, a statistically non-responsive household may indicate a communication, switch, or A/C unit failure, however there are a number of other likely factors to consider. For example, occupants may be away during an event or have temporarily changed the household’s temperature set point. On event days with cooler weather or lower cycling rates it is harder for the model to confidently identify a demand reduction, as a result the NCH rate tends to be higher. The model utilizes a three step calculation process to identify NCHs: 1. The first calculation is a Cumulative Sum (CSUM) analysis, which is a technique that evaluates the slope of a smoothed curve of energy usage data for the hours before and during the event, and comparing the ratios of these slopes to determine if there is a significant change in demand due to the event. Devices with a slope ratio less than one are considered contributing devices. 2. The second calculation is the linear decrease analysis, which involves comparing the consumption for the hour prior to the event to the consumption during the first hour of the event. Devices that do not see a 10% reduction in this step are considered non- contributing devices. 3. Finally, the model performs a check for signs of a snapback effect, which is the increase above baseline usage that frequently occurs at the conclusion of a demand response event as an A/C unit works to return to the household to normal set temperature. Households that were labeled as non-contributing by the first two tests but show signs of a snapback effect are reclassified as contributing households. Results The following tables and charts display the outputs of the evaluation models. All demand reduction numbers presented in the text and figures of this report are calculated at the generator level which includes an overall system loss number of 9.7%. For simplicity, only Treasure Valley temperature data is shown in the charts below. However, the underlying baseline evaluation model utilizes weather reads from both the Treasure Valley region and the Twin Falls/Pocatello region. 5 Tables Table 2. 2022 Event Details Event Date Event Time Peak Temperature Cycle Rate Average Reduction Total Reduction Jul 7 6-9 p.m. 94°F 55% 0.6 kW 11.4 MW Jul 27 4-8 p.m. 101°F 50% 0.87 kW 16.7 MW Jul 28 4-8 p.m. 103°F 50% 0.94 kW 18.1 MW Jul 29 4-8 p.m. 104°F 50% 1.05 kW 20.1 MW Aug 1 6-9 p.m. 102°F 55% 0.98 kW 18.7 MW Aug 8 5-8 p.m. 102°F 55% 0.86 kW 16.4 MW Aug 9 5-8 p.m. 98°F 55% 0.88 kW 16.8 MW Aug 17 6-10 p.m. 102°F 50% 0.76 kW 14.5 MW Aug 31 6-10 p.m. 105°F 50% 0.78 kW 14.9 MW Sep 1 5-8 p.m. 97°F 55% 0.82 kW 15.7 MW Sep 2 5-9 p.m. 100°F 50% 0.81 kW 15.5 MW Sep 6 5-9 p.m. 100°F 50% 0.68 kW 12.9 MW Sep 7 5-9 p.m. 104°F 50% 0.9 kW 17.1 MW 6 Table 3. 2022 Household Non-Contribution Results Event Date Non-Contribution Ratio Jul 7 20.5% Jul 27 18.4% Jul 28 16.3% Jul 29 16.2% Aug 1 8.7% Aug 8 17% Aug 9 15.5% Aug 17 15.9% Aug 31 15.2% Sep 1 20.6% Sep 2 31.4% Sep 6 29.8% Sep 7 20.6% 7 Charts Figure 2. Household Results by Event 8 Figure 3. Household Proxy Day Performance March 8, 2023 2022 Flex Peak Program End-of-Season Annual Report Flex Peak Program Report Page i TABLE OF CONTENTS Table of Contents .............................................................................................................................. i List of Tables .................................................................................................................................... ii List of Figures ................................................................................................................................... ii Introduction .................................................................................................................................... 1 Background ..................................................................................................................................... 1 Program Details ......................................................................................................................... 2 Program Incentives ................................................................................................................... 3 Program Results .............................................................................................................................. 3 Participation .............................................................................................................................. 4 Operations ................................................................................................................................ 6 Load Reduction Analysis ........................................................................................................... 7 Program Costs ......................................................................................................................... 12 Conclusion ..................................................................................................................................... 12 Idaho Power Page ii Flex Peak Program Report LIST OF TABLES Table 1. 2022 Incentive Structure ................................................................................................... 3 Table 2. Realization rate per event - 2022 ...................................................................................... 9 Table 3. Realization Rate Per Participant for Each Event - 2022 .................................................. 10 Table 4. Annual Program Costs – 2022 ......................................................................................... 12 LIST OF FIGURES Figure 1. Idaho Power’s Service Area ............................................................................................ 5 Figure 2. 2022 Enrolled Capacity (% of Total Nomination) by Region ........................................... 5 Figure 3. 2022 Enrolled Capacity (Total Nomination) by Business Type ....................................... 6 Figure 4. Range of Nominated Load Reduction (kW) .................................................................... 8 Figure 5. Average and Maximum Reduction Achieved per Event ................................................. 8 Figure 6. Average Realization Rate by Each Nomination Size Class .............................................. 9 Idaho Power Company 2022 Flex Peak Program Report Page 1 INTRODUCTION The Flex Peak Program (program) has been operated by Idaho Power Company (Idaho Power or company) since 2015. The program is a voluntary demand response (DR) program available to large commercial and industrial customers that can reduce their electrical energy loads for short periods during summer peak days. This program, along with Idaho Power’s other DR programs—Irrigation Peak Rewards and the residential A/C Cool Credit program—have helped delay the need for new supply-side resources. The results presented in this report are from the 2022 program season, the company’s eighth year of operating the program internally. The 2022 program season had a decrease in load reduction and realization rates from the prior year (2021). There were 25 new sites added, and overall participation resulted in the highest hourly load reduction for the season of 24.5 megawatts (MW). The average realization rate for the seven load reduction events that occurred in the 2022 program season was 63%. Enrollment increased slightly in 2022, and 96% of previously participating sites re-enrolled in the program. The maximum available capacity of the program came from the nominated amount in week three of 30 MW. The total program costs through December 31, 2022, were $519,618. BACKGROUND In 2015, the company requested approval to implement the Flex Peak Program as an Idaho Power operated program. The Idaho Public Utilities Commission (IPUC) approved the company’s request in Order No. 33292,1 and the Public Utility Commission of Oregon (OPUC) accepted the proposal from Advice No. 15-03.2 Prior to 2015, a similar DR program for commercial and industrial customers was operated by a third-party vendor. As part of Advice No. 15-03, the OPUC adopted Staff’s recommendation that the company file an annual end-of-season report with information regarding the program. The company was also directed by the IPUC in Order No. 33292 to file an annual end-of-season report detailing the results of the program. In compliance with the reporting requirements, the annual end-of- season report includes the following: • Number of participating customers • Number of participating sites • MW of demand response under contract 1 In the Matter of Idaho Power’s Company’s Application for Approval of New Tariff Schedule 82, A Commercial and Industrial Demand-Response Program (Flex Peak Program), Case No. IPC-E-15-03, Order No. 33292 (May 7, 2015). 2 Schedule 76, Flex Peak Program, Docket No. ADV 7/Advice No. 15-03 (approved April 28, 2015). Idaho Power Company Page 2 2022 Flex Peak Program Report • MW of demand response realized and incented per dispatch • Percent of nominated MW achieved in each dispatch event by participant • Cost analysis of the program • Number of events called • Total load dropped for each event • Event duration • Total capacity payments made • Total energy payments made • Number of customers who failed to meet their load • Number of program applications denied due to program subscription limit • Participant attrition • Issues the utility has identified meeting requests to participate in the program • Changes in baseline methodology taken or anticipated • Improvements Idaho Power and the program might benefit from Program Details The program pays participants a financial incentive for reducing load within their facility and is active June 15 to September 15, between the hours of 3 p.m. and 10 p.m. on non-holiday weekdays. Customers with the ability to nominate or provide load reduction of at least 20 kW are eligible to enroll in the program. The 20 kW threshold allows a broad range of customers to participate. The parameters of the program are in Schedule 763 in Oregon and Schedule 824 in Idaho, and include the following: • A minimum of three load reduction events will occur each program season. • Events can occur any weekday (excluding July 4 and Labor Day) between the hours of 3 p.m. and 10 p.m. and last between two to four hours • Events can occur up to four hours per day and up to 16 hours per week, but no more than 60 hours per program season • Idaho Power will provide notification to participants four hours prior to the initiation of an event • If prior notice of a load reduction event has been sent, Idaho Power can choose to cancel the event and notify participants of cancellation 30 minutes prior to the start of the event 3 Idaho Power Company, P.U.C. ORE. No. E-27, Schedule 76. 4 Idaho Power Company, I.P.U.C. No. 29, Tariff No. 101, Schedule 82. Idaho Power Company 2022 Flex Peak Program Report Page 3 Program Incentives The program includes both a fixed and variable incentive payment. The fixed incentive is calculated by multiplying the actual kW reduction by $3.25 for weeks when an event is called or the weekly nominated kW amount by $3.25 for weeks when an event is not called. The variable energy incentive is calculated by multiplying the kW reduction by the event duration hours to achieve the total kilowatt-hour (kWh) reduction during an event. The variable incentive payment is $0.20 per kWh and is implemented for events that occur after the first four events. The program also includes an incentive adjustment of $2.00 per kW not achieved for each event hour when participants do not achieve their nominated amount during load reduction events, which is subtracted from their credit or payment. Incentives are calculated using Idaho Power’s interval metering billing data; participants were issued the incentives within 30 days of the end of the program season. Participants can elect to have their incentive checks mailed or their Idaho Power account credited within the 30 days. The incentive structure offered for the 2022 season is listed in Table 1. Table 1. 2022 Incentive Structure Fixed-Capacity Payment Rate* Variable Energy Payment Rate** $3.25 per Weekly Effective kW Reduction Adjustment (subtracted from payment) $2.00 per kW of nomination not achieved for each hour of the event $0.20 per kWh (Actual kW reduction x Hours of Event) *To be prorated for partial weeks **Does not apply to first four program events PROGRAM RESULTS The results presented throughout this report are at the generation level and system losses have been considered. Idaho Power called seven load reduction events in 2022: two events in July, three events in August, and two events in September. The maximum realization rate achieved during the season was 86% during the event on July 28 and the average for all seven events combined was 63%. The realization rate is the percentage of load reduction achieved versus the amount of load reduction committed for an event. The highest hourly load reduction achieved was during the July 28th event at 24.5 MW. Participants had a committed load reduction of 29.5 MW in the first week of the program season and ended with 27.2 MW at the end of the season. This was a decrease from the 2021 season as participants had a committed load reduction of 36 MW in the first week of the 2021 season and ended with 29.7 MW. This weekly commitment, or “nomination,” was comprised of customers participating in the program totaling 159 sites as compared to 139 sites in 2021. The Idaho Power Company Page 4 2022 Flex Peak Program Report maximum available capacity of the program came from a nominated amount in week three at 30 MW. In past years, certain events have achieved higher than a 100% realization rate which would make this the maximum potential available capacity for the program. Enrollment specific to the Oregon service area included 6 participants totaling 9 sites enrolled. These 9 sites had an average nominated capacity for the season of 4.8 MW and achieved a maximum reduction during the season of 5.6 MW during hour four on the August 8 event. Participation The number of sites enrolled in the program for 2022 was 159 from 69 participants. The average number of sites enrolled per participating customer was 2.3. A total of 134 of the 139 sites that participated in 2021 re-enrolled in the program in 2022. The four customers (five sites) that did not re-enroll made the decision that demand reduction was not in line with their facilities’ needs for 2022. There was one customer that terminated their participation early in the 2022 season due to extensive electrical upgrades which kept them from curtailing usage when events were called. This past season Idaho Power continued the auto-enrollment option where existing participants were re-enrolled in the program automatically: a confirmation packet was mailed early in April based on the prior year’s enrollment information. Participants notified the company in writing to disenroll, to change their nomination amount, or to update/change contact information regarding personnel for event notification. The auto-enrollment process has proven to be successful, and the company anticipates utilizing this process in the future. The 2022 season was the first year with the new program parameters per Idaho Case IPC-E-21- 32 and Oregon Docket No. ADV 1355/Advice No. 21-12, which replaced the 13-14 Settlement agreement. The company did deny one program application in 2022, as the applicant was not able to meet the 20 kW minimum load reduction. Figure 1 represents Idaho Power’s service area divided into three regional areas: Canyon-West (Canyon and Western), Capital, and South-East (Southern and Eastern). Figure 2 represents the enrolled capacity (total nominations) that were enrolled in 2022 and the distribution by Idaho Power’s regional service areas. Figure 3 represents the enrolled capacity in 2022 and the diversity based on business type. Idaho Power Company 2022 Flex Peak Program Report Page 5 Figure 1. Idaho Power’s Service Area Figure 2. 2022 Enrolled Capacity (% of Total Nomination) by Region Canyon- West 34% Capital 29% South- Eastern 37% Idaho Power Company Page 6 2022 Flex Peak Program Report Figure 3. 2022 Enrolled Capacity (Total Nomination) by Business Type Operations After an event, interval metering data provides Idaho Power the ability to view a history of each participant’s load before, during, and after events. The metering data was used to calculate the reduction achieved per site for each event, allowing Idaho Power to provide participants with a report that showed their hourly baseline, actual usage, and reduction for each event. This data can assist participants in refining their nomination for future events and aids Idaho Power in determining which sites may have an opportunity to provide more reduction or change their reduction strategy if nomination amounts were not achieved. The company believes by calling at least three events per season the program will be more effective in providing consistent and reliable reduction. A minimum of three events allows the company to test processes and software and helps customers fine tune their curtailment plan. The company called seven load reduction events during the 2022 program season which is the first time this has occurred since 2012. This past season was extremely hot and dry across the west with constraints across the Pacific Northwest that impacted energy availability; as a result, the program was utilized more often. In all seven events the program provided a resource to assist Load Serving Operators with balancing load and resources, as well as potentially avoiding additional market purchases. The variable energy price for utilizing the program after the fourth event was $0.20/kWh and could be considered the dispatch price for calling load reduction events beginning with the fifth event. The price of $0.20/kWh is typically higher than the energy market price. The company believes the variable energy price is appropriate because having a dispatch price below Agriculture 4% Commercial Property 9% Other 3% Education 9% Refrigerated Warehouse 11%Water & Wastewater Treatment Facility 16% Asphalt, Concrete, Gravel 17% Light Industrial 8% Food Processing 22% Idaho Power Company 2022 Flex Peak Program Report Page 7 $0.20/kWh could cause the company to call events more frequently resulting in reduced participant performance and event fatigue. Load Reduction Analysis The baseline that reductions are measured against during load reduction events is the average kW of the highest energy usage days during the event availability time (3-10 p.m.) from the highest three days out of the last 10 non-event weekdays. The baseline with a Day-of- Adjustment (DOA) methodology used in 2022 was changed slightly to be consistent with the updated event availability time (3-10 p.m.) and to reflect more accurate load reductions. Individual baselines are calculated for each facility site. Once the original baseline is calculated, a DOA adjustment is used to more accurately reflect the load behavior of the participant on event day. The DOA is the difference between the average baseline kW and the average curtailment day kW during the hour prior to the participant receiving notification of an event, and can be an upward or downward adjustment. Scaling factors are calculated by dividing the original baseline kW for each program event hour by the baseline kW of the hour preceding the event notification time. The actual event day kW for the hour preceding the event notification time is then multiplied by the scaling factor to calculate the adjusted baseline kW from which load reduction is measured. The adjusted baseline kW for each hour cannot exceed the maximum kW amount for any hour from the highest energy use days or the hours during the event day prior to event notification. Sites are classified into four size segments based on nomination: 0-50 kW, 51-200 kW, 201-500 kW, and 500+ kW. As Figure 4 depicts, the nomination group with the most sites was in the 0- 200 kW range, accounting for approximately 79% of the sites. Figure 5 shows both the average and maximum demand reduction achieved during each of the seven curtailment events. Figure 6 represents the realization rate achieved by each nomination group, averaged across all seven events. To calculate the results, each site’s average load reduction (across seven events) was divided by its average nomination across the seven events and then grouped by size. Idaho Power will continue to work with all customer segments to help refine nominations to align closer with realistic reduction opportunities, which will increase the overall program realization rate. Based on Figure 5 and Figure 6, the segment with the smallest nominated load reduction, 0–50 kW, had the highest number of sites enrolled (66 sites) with an achieved realization rate across the seven events at 62%. The 51–200 kW segment had the second highest number of sites enrolled (60 sites) and achieved the highest average realization rate of all groups at 80%. The 201-500 kW group had 25 sites enrolled and achieved a realization rate of 58%. The largest size class, 501+ kW, had 8 sites enrolled and achieved an average realization rate across the seven events at 52%. Idaho Power Company Page 8 2022 Flex Peak Program Report Figure 4. Range of Nominated Load Reduction (kW) Figure 5. Average and Maximum Reduction Achieved per Event 66 60 25 8 52 52 26 9 0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 0-50 51-200 201-500 501+ Co u n t o f S i t e s Nominated Amount 2022 2021 18.2 21.6 20.4 20.3 17.0 12.5 14.6 18.7 24.6 21.1 21.1 19.2 14.4 15.6 0 5 10 15 20 25 30 26-Jul 28-Jul 8-Aug 17-Aug 31-Aug 2-Sep 6-Sep Me g a w a t t s ( M W ) Event Date Average Demand Reduction Max Demand Reduction Idaho Power Company 2022 Flex Peak Program Report Page 9 Figure 6. Average Realization Rate by Each Nomination Size Class Table 2 shows the program realization rates for 2022 based on average demand reduction per event. The maximum demand reduction achieved ranged from a low of 14 MW with a maximum demand reduction realization rate of 53% to a high of 24.5 MW with a maximum demand reduction realization rate of 86%. The average demand reduction realization rate for the 2022 season was 63%. Table 2. Realization rate per event - 2022 Curtailment Event Event Timeframe Nominated Demand Reduction Average Demand Reduction (MW) Max Demand Reduction (MW) Realization Rate* July 26 5-9 pm 28.6 18.2 18.7 64% July 28 5-9 pm 28.6 21.6 24.5 76% August 8 5-9 pm 28.7 20.4 21.1 71% August 17 5-9 pm 28.6 20.3 21.1 71% August 31 6-10 pm 28.2 17 19.2 60% September 2 5-9 pm 27.3 12.5 14.4 45% September 6 5-9 pm 27.3 14.6 15.6 53% Average 28.2 17.8 19.2 63% * Based on average reduction Event performance and realization rates for the 2022 season were reduced due to the impact of COVID-19 such as supply chain and production issues. Typically, the program achieves a 62% 80% 58% 52% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 0-50 51-200 201-500 501+ Re a l i z a t i o n R a t e Range of Nominated Load Reduction (kW) Idaho Power Company Page 10 2022 Flex Peak Program Report realization rate of 85%. The baseline and DOA methodology changed this year as well as the program parameters. COVID-19 has changed business operations, which will have an ongoing effect on how businesses can curtail load. Also, the later event times have impacted many customers’ ability to get the load reductions that were more attainable with earlier event hours. Additionally, this was the first season in eight years that had more than five events called which could have also had an impact on customers’ operations. More events may have resulted in some participants being less able to participate in all events as the season progressed. Table 3 shows the realization rate for each participant in the program for 2022. Table 3. Realization Rate Per Participant for Each Event - 2022 Participant Number July 26 Event Realization July 28 Event Realization August 8 Event Realization August 17 Event Realization August 31 Event Realization September 2 Event Realization September 6 Event Realization 1 0% 239% 214% 93% 118% 136% 0% 2 24% 6% 4% 14% 0% 5% 5% 3 33% 48% 22% 28% 7% 3% 24% 4 34% 19% 164% 73% 148% 69% 0% 5 96% 97% 133% 125% 78% 61% 97% 6 76% 32% 0% 0% 28% 5% 0% 7 76% 13% 97% 87% 42% 9% 7% 8 87% 74% 73% 87% 53% Opt out Opt out 9 207% 291% 104% 253% 260% 262% 47% 10 13% 0% 187% 130% 60% 0% 100% 11 136% 155% 90% 10% 8% 81% 55% 12 18% 33% 75% 3% 126% 16% 11% 13 7% 8% 35% 23% 98% 111% 16% 14 4% 4% 42% 12% 7% 124% 2% 15 28% 32% 101% 0% 191% 126% 115% 16 99% 243% 130% 346% 138% 147% 16% 17 3% 98% 1% 20% 132% 9% 122% 18 3% 3% 0% 0% 2% 4% 2% 19 9% 10% 20% 23% 4% 0% 0% 20 108% 187% 90% 131% 91% 58% 97% 21 116% 113% 155% 77% 36% 212% 0% 22 229% 253% 178% 199% 70% 76% 26% 23 18% 66% 74% 44% 51% 61% 38% 24 152% 132% 16% 101% 0% 66% 87% 25 155% 156% 142% 113% 4% 0% 124% 26 0% 3% 1% 0% 1% 11% 8% Idaho Power Company 2022 Flex Peak Program Report Page 11 27 639% 96% 145% 448% 75% 179% 70% 28 193% 146% 161% 183% 107% 0% 186% 29 0% 3% 39% 115% 95% 0% 0% 30 2% 0% 21% 46% 9% 2% 1% 31 109% 131% 70% 122% 10% 2% 5% 32 1% 4% 9% 13% 46% 6% 8% 33 11% 10% 2% 9% 38% 5% 19% 34 100% 15% 46% 0% 40% 12% 158% 35 45% 205% 208% 0% 130% 0% 217% 36 0% 59% 165% 71% 134% 182% 363% 37 91% 59% 12% 6% 0% 5% 13% 38 32% 120% 31% 60% 151% 28% 117% 39 0% 0% 0% 0% 0% 0% 0% 40 35% 82% 13% 25% 8% 0% 0% 41 76% 9% 1% 16% 23% 2% 4% 42 114% 138% 180% 208% 247% 26% 189% 43 28% 180% 152% 73% 0% 88% 3% 44 74% 51% 0% 0% 0% 5% 0% 45 2% 0% 73% 21% 18% 17% 17% 46 91% 48% 73% 205% 45% 37% 38% 47 0% 42% 5% 49% 0% 3% 0% 48 25% 13% 4% 20% 13% 19% 9% 49 0% 0% 1% 3% 3% 4% 11% 50 0% 51% 42% 55% 58% 59% 56% 51 0% 0% 0% 0% 0% 0% 0% 52 0% 71% 8% 10% 18% 44% 55% 53 1% 18% 0% 2% 63% 3% 41% 54 0% 7% 0% 6% 27% 46% 1% 55 98% 2% 96% 89% 92% 98% 88% 56 64% 0% 85% 18% 39% 33% 88% 57 51% 45% 31% 24% 59% 68% 61% 58 77% 40% 80% 87% 82% 87% 75% 59 6% 2% 126% 3% 2% 3% 2% 60 39% 72% 50% 100% 102% 74% 80% 61 54% 64% 95% 93% 97% 96% 93% 62 112% 126% 45% 101% 96% 26% 99% 63 21% 21% 0% 88% 15% 0% 1% 64 640% 757% 370% 500% 584% 21% 262% Idaho Power Company Page 12 2022 Flex Peak Program Report 65 67% 48% 5% 20% 19% 14% 24% 66 115% 80% 94% 92% 70% 95% 131% 67 116% 139% 110% 69% 57% 17% 82% 68 5% 7% 7% 0% 1% 1% 2% 69 N/A* N/A* N/A* N/A* N/A* N/A* N/A* *Participant #69 terminated their participation in the program on July 8th. Program Costs Program costs for 2022 totaled $519,618. Incentive payments were the largest expenditure, comprising approximately 83% of total costs. The incentive payments from the seven events called during the 2022 program season were broken down as follows: the fixed capacity payments total was $430,322 and the variable energy payment total was $28,890. Variable energy payments were made during the season based on kilowatt-hour reductions for the fifth, sixth, and seventh events. Table 4. Annual Program Costs – 2022 Expense Category 2022 Program Costs Materials & Equipment $ 8,446 Marketing & Administration $ 80,851 Incentive payments $430,322 Total $519,618 CONCLUSION The program currently contributes approximately 9% of the company’s overall DR portfolio and can be relied on to provide dispatchable load reduction to the electrical grid. When analyzing the program at the generation level, industrial and commercial customers have made noteworthy contributions to Idaho Power’s DR programs. 2022 Irrigation Peak Rewards Program Report January 2023 © 2023 Idaho Power Idaho Power 2022 Irrigation Peak Rewards Program Report Page i TABLE OF CONTENTS Table of Contents .............................................................................................................................. i List of Tables .................................................................................................................................... ii List of Figures ................................................................................................................................... ii List of Appendices ............................................................................................................................ ii Introduction .................................................................................................................................... 1 Program Description ................................................................................................................. 1 Interruption Options ........................................................................................................... 1 Parameters .......................................................................................................................... 2 Fixed and Variable Incentives ............................................................................................. 2 Opt-Outs .............................................................................................................................. 3 Participation .................................................................................................................................... 3 Operations ...................................................................................................................................... 4 Equipment ................................................................................................................................. 4 Monitoring ................................................................................................................................ 5 Data Gathering and Processing ................................................................................................. 5 Load Reduction Analysis ................................................................................................................. 6 Baseline Calculations and Event Reduction Calculations ......................................................... 6 Event Day Highlights ................................................................................................................. 7 July 7 ................................................................................................................................... 7 July 12 ................................................................................................................................. 7 July 26 ................................................................................................................................. 7 July 27 ................................................................................................................................. 8 July 28 ................................................................................................................................. 8 July 29 ................................................................................................................................. 8 August 8 .............................................................................................................................. 8 August 9 .............................................................................................................................. 8 August 17 ............................................................................................................................ 8 September 2 ........................................................................................................................ 9 September 6 ........................................................................................................................ 9 2022 Irrigation Peak Rewards Program Report Idaho Power Page ii Potential Realization Rate Analysis ........................................................................................... 9 Load Reduction Results—Total System Load Data ................................................................. 10 Costs .............................................................................................................................................. 12 Conclusions ................................................................................................................................... 13 LIST OF TABLES Table 1. Monthly fixed billing credits for manual and automatic options ..................................... 2 Table 2. Variable incentive after the fourth event ......................................................................... 3 Table 3. Eligible pump locations and participation levels by area.................................................. 4 Table 4. Hourly demand reduction results (MW) for each event and groups called, including line losses ...................................................................................................... 7 Table 5. Total left on and average MW on during each event ....................................................... 9 Table 6. Annual program costs by category ................................................................................. 13 LIST OF FIGURES Figure 1. Idaho Power service area ................................................................................................. 3 Figure 2. 2022 percentage of participants by service area ............................................................ 4 Figure 3. 2022 Participant Demand and Realization Rate (%) ...................................................... 10 LIST OF APPENDICES Appendix 1. The Demand Reduction Calculation Method Idaho Power 2022 Irrigation Peak Rewards Program Report Page 1 INTRODUCTION The Irrigation Peak Rewards Program (IPR) is a voluntary demand response program available to Idaho Power’s agricultural irrigation customers since 2004. IPR pays irrigation customers a financial incentive for the ability to turn off participating irrigation pumps on high energy use days. Idaho Power estimates future capacity needs through the Integrated Resource Plan and then plans resources to mitigate shortfalls. IPR is a result of this planning process and the success of the program is measured by the amount of demand reduction available to Idaho Power during during periods of high energy demand or for other system needs. Program Description Interruption Options IPR is available to Idaho Power irrigation customers receiving service under schedules 24 and 84 in Idaho and Oregon. All Irrigation customers are eligible to participate. There are two options for shut off: an automatic dispatch option and a manual dispatch option. The program is limited to 4 hours per service location from 3-10 p.m. (standard option) or for 4 hours during the period from 3-11 p.m. (extended option). The program is limited to 16 hours per week and 60 hours per season. However, due the size of the program, the participants have been split into four groups which can be used independently on different days or used all together at the same time or staggered out at different times on an event day. If five or more events are dispatched for a group, the participants enrolled in the standard option will receive an additional variable payment of $0.18 per kilowatt (kW) billed x 4 hours. Participants enrolled in the extended option (3-11 p.m.) are eligible for an extended variable payment of $0.25 per kW billed x 4 hours. In 2022, participants were organized into four categories and labeled groups A, B, C, and D. Automatic Dispatch Option Pumps enrolled in the automatic dispatch option have one of two devices installed that control the irrigation pump(s) via signal from Idaho Power. This option requires that all pumps shut off at a site for the demand-response event. Approximately 99% of the devices are demand response units (DRU) and use Idaho Power’s Automated Metering Infrastructure (AMI) to send a signal that opens the contactor and shuts off the pump. The other 1% of automatic dispatch participants have a cellular device (cell device) installed. The cell device has the same load control feature as the AMI DRU, except a cellular network signal is used to send the command for shut off during the event. Manual Dispatch Option Pumps with at least 1,000 cumulative horse power (hp) or that Idaho Power has determined to have limited communication availability are eligible for the manual dispatch option, where participants manually control which pumps are turned off during a load control event. Manual participants are required to select a nominated load reduction of kW available and anticipated for shut off during the season. They may choose to shut down all or partial load at the site. 2022 Irrigation Peak Rewards Program Report Idaho Power Page 2 Parameters • Season dates June 15 to September 15 • Minimum of three load control events • Load control events may occur any weekday or Saturday, excluding July 4 and September 5, between the hours of 3-10 p.m. (standard option), or between the hours of 3-11 p.m. (extended option) • Load control events may occur up to four hours per day and up to 16 hours per week, but no more than 60 hours per program season—applies to both standard option and extended option • Idaho Power notifies automatic participants by phone, email, and/or text messaging four hours before the start of the event whenever possible • Idaho Power notifies manual participants by phone, email, and/or text four hours before the start of the event • Idaho Power may cancel the load control event and notify participants of the cancellation up to 30 minutes before the event start time • Parameters for IPR do not apply to system emergencies Fixed and Variable Incentives The IPR incentive structure includes fixed incentives (billing credits) and variable event-related incentives. Participants receive fixed incentives in the form of monthly billing credits that are not tied to events: a demand credit and an energy credit. The fixed demand and fixed energy credits for the automatic dispatch participants were applied to the monthly bill for billing dates June 15 through September 15. The fixed demand and fixed energy credits for the manual dispatch participants were paid with a check. • Fixed demand credits are calculated by multiplying the monthly billing kW by the demand-related incentive amount • Fixed energy credits are calculated by multiplying the monthly billing kilowatt-hour (kWh) usage by the energy-related incentive amount Credits are prorated for periods when meter reading/billing cycles do not align with the IPR season dates. Monthly billing credits for 2022 are summarized in Table 1. Table 1. Monthly fixed billing credits for manual and automatic options Fixed Demand Credit ($/billing kW) Fixed Energy Credit ($/billing kWh) $5.25 $0.008 Variable incentives apply if more than four events occur in the season. Participants who choose the extended option (3–11 p.m.) are paid a higher variable credit. In 2022 group A and D experienced a total Idaho Power 2022 Irrigation Peak Rewards Program Report Page 3 of six events and groups B and C experienced seven events which caused the variable payments to be initiated. The variable incentive rates for 2022 are listed in Table 2. Table 2. Variable incentive after the fourth event Standard Option 3–10 p.m. Variable Energy Credit per hour ($/billing kW) Extended Option 3–11 p.m. Variable Energy Credit per hour ($/billing kW) $0.18 $0.25 Opt-Outs Under the rules of the automatic dispatch option, participants have the option to opt out of any load control event. Opt-out fees are equal to $6.25 multiplied by the billed kW for that billing cycle. An explicit opt-out occurs when the participant asks Idaho Power to remove the pump for that specific load control event. PARTICIPATION In March 2022, Idaho Power mailed IPR enrollment packets to all customers. The packets included an enrollment worksheet with estimated credits for participation, contact worksheets, and an IPR brochure. Nominated billing demand was 346,333 kilowatts (kW) with 2,142 pumps enrolled for the 2022 season. Figure 1 shows Idaho Power’s service area divided into three regional areas: Canyon–West, Capital, and South–East. Also referenced within this report are sub-areas within the Canyon-West region (Western, Canyon, and Oregon) and sub-areas within the South-East region (Southern and Eastern). Figure 1. Idaho Power service area 2022 Irrigation Peak Rewards Program Report Idaho Power Page 4 Figure 2. 2022 percentage of participants by service area Table 3. Eligible pump locations and participation levels by area Idaho Power Regional Area Eligible Service Locations Manual Dispatch Option Automatic Dispatch Option Total Enrolled by Area Eligible Enrolled Canyon 2,888 39 39 1.4% Western 4,497 52 52 1.2% Oregon 104 3 61 64 61.5% Capital 1,879 23 246 269 14.3% Eastern 3,549 977 977 27.5% Southern 8,693 4 737 741 8.5% Totals 21,610 30 2,112 2,142 9.9% OPERATIONS Equipment Idaho Power has expanded the use of AMI technology with the use of DRUs installed at pump locations. AMI technology provides the ability to turn off pumps during an IPR event by sending a command through the power line, and allows Idaho Power to analyze the interval metering data of participating pumps during load control events. Interval metering reports provide data to help determine which DRUs functioned properly and which pumps were turned off and stayed off during the event. During the 2022 season 2,376 DRUs were active and installed at 2,078 pump locations. 6.04% 15.17% 42.60% 32.44% 1.61% 2.15% Canyon Capital Eastern Southern Western Oregon Idaho Power 2022 Irrigation Peak Rewards Program Report Page 5 In addition to using AMI technology, Idaho Power developed its own load control device. This device utilizes a cellular network signal to communicate with and shut off the pump during a load control event. The data available from the cellular device systems allows Idaho Power to view status information for each location. Hourly usage data is not available for these sites. During the end of 2020 and the spring of 2021 many of the cellular devices were exchanged for the DRU due to an AMI substation expansion project. Only 33 pump locations remain with 39 cellular devices. Monitoring Identification and correction of device failure is an ongoing effort before the season begins and throughout the season. Proper identification of malfunctioning devices helps to accurately predict the load reduction. Based on information and assumptions made using the interval metering data and the communication reports provided weekly, a work order may be created and sent to the electrician to troubleshoot the device. Often it is found the device is not working or damaged and exchanged for a new device. Several issues with DRUs and cell devices were identified in 2022, including: • Inoperable • Damaged • Device missing a fuse • DRU serial number or cell device IP address and/or SG number had been recorded inaccurately and the system could not find the correct communication path • New panel install at the pump site requiring a new device install on the new panel • Water damage to the device • Device—no longer at the pump location Data Gathering and Processing Troubleshooting, electrician work orders, and load reduction calculations are informed by the interval metering data analysis. Data gathering includes AMI data, cellular device data, MV-90 hourly data, and logged data from manually read meters. The data is then separated into three data sets: 1. Pumps with AMI technology and interval metering data 2. Pumps with cellular device data 3. Pumps running on the manual dispatch option with interval data The AMI data, Cellular data, MV-90 data and logged data from manually read meters record the hourly reads. The data is useful for troubleshooting of devices and to calculate load reduction for the program. 2022 Irrigation Peak Rewards Program Report Idaho Power Page 6 LOAD REDUCTION ANALYSIS The load reduction analysis or program performance for the season is calculated using four primary sources: 1. Participating service location list 2. Interval metering data 3. Cellular device communication data from event days 4. Total system load data for event days and surrogate days The IPR participant data for each event day includes the following: • Pump number • Device Location • 2022 dispatch option • 2022 dispatch group • Nominated kW • Cellular device or DRU serial number or identified as a manual site Idaho Power system load monitoring was used as a comparison for impact of the load reduction during the event. The total system load monitoring provides MW readings in 5-minute increments. Baseline Calculations and Event Reduction Calculations Calculating the performance of the program requires a comparison between usage before the event (baseline usage) and usage during the event. See Appendix 1 for the definition of terms and the demand reduction calculation method. The descriptions below outline the process. Table 4 displays the load reduction results for each event day. The load reduction at generation level includes a 9.7 percent line loss. • Baseline usage is calculated using the average of the first four hours of the five hours before the dispatch group start time. • The event hour reduction is calculated using the average of the event timeframe for each dispatch group. • Data with errors are removed from the data set and the group average is extrapolated and used in place of the error set. • Load reduction for service locations with interval metering data (AMI, MV-90, and manual data loggers) is calculated and then extrapolated to represent all load including those with errors and without interval metering data. Idaho Power 2022 Irrigation Peak Rewards Program Report Page 7 • 2112 pump locations had interval data in 2022, representing 98.6% of the total enrolled pump locations. Table 4. Hourly demand reduction results (MW) for each event and groups called, including line losses Event Date Groups* Hourly Load Reduction (MW) 3–4 p.m. 4–5 p.m. 5–6 p.m. 6–7 p.m. 7–8 p.m. 8–9 p.m. 9–10 p.m. 7/7/2022 A, B 115.3 121.2 119.5 119.1 7/12/2022 C, D 5.5 67.1 109.1 108.9 101.1 40.5 7/26/2022 A, C 3.1 68.5 113.5 113.5 108.7 43.0 7/27/2022 B, D 42.2 75.8 76.2 75.8 32.5 7/28/2022 A, C 5.1 59.7 102.6 102.1 96.1 40.6 7/29/2022 B, D 40.4 40.5 76.2 76.8 35.5 35.0 8/8/2022 C, D 16.3 54.4 83.9 80.6 67.8 30.2 8/9/2022 A, B 40.1 74.0 75.1 74.6 33.7 8/17/2022 B, C 4.1 55.8 86.7 86.8 81.4 29.5 9/2/2022 A, B, C, D 4.5 43.7 117.7 155.1 147.3 110.2 37.5 9/6/2022 A, B,C, D 102.8 122.7 151.0 152.1 *Group C had some customers on an early off time. Event Day Highlights July 7 The first event, a Thursday, was sixteen days into the program season and the temperature was 95° F in Boise. Groups A and B were dispatched for shut off. Idaho Power received 80 opt-outs. The opt-out reasons noted were “must have the water,” “too dry, can’t catch up,” “water just came back on and I cannot have it go off again now.” Due to several devices being set up in an incorrect cycle group, some service locations were dispatched differently than customer expectations. This caused customer confusion because some customers were notified but not cycled, and some customers were cycled but not notified. This issue also caused higher opt-outs and resetting of pump panels which caused device failure numbers to look higher. The issue was addressed when it was realized after the July 12 event. July 12 The second event occurred on a Tuesday following a record high heat wave in the northwest including heat cones over Seattle and Portland. The temperature was 100° F in Boise. Groups C and D were dispatched for shut off. The event started at 4:00 p.m. and experienced 18 opt-outs. The issue that the program experienced in the July 7 event was not discovered and therefore customers experienced similar dispatch issues. After this event the issue was identified and corrected. July 26 The third event occurred on a Tuesday. Groups A and C were dispatched for shut off. The event started at 4:00 p.m. and the temperature was 100° F in Boise. For this event, there were five opt-outs and many of them were the same as the previous event. It seemed that the stress for irrigators had lessened this 2022 Irrigation Peak Rewards Program Report Idaho Power Page 8 late in the season as some crops were harvested entirely and others had a mature canopy, thus four hours of no water was less of an issue. The notifications to participants went out as designed and the communication to the DRUs and cell devices occurred without delays. July 27 The fourth event occurred on a Wednesday. Idaho Power had called the program on Tuesday of this same week, so on Wednesday different groups were called. The temperature was 100° F in Boise. Groups B and D were dispatched for shut off. The event started at 5:00 p.m. with 16 opt-outs. The notifications to participants went out as designed and the communication to the DRUs and cell devices occurred without delays. Overall the event went smoothly with only a little feedback from the participants. July 28 The fifth event occurred on a Thursday. Groups A and C were dispatched for shut off. The event started at 4:00 p.m. and 35 pumps opted out; a few of the opt-out calls indicated the pump/water had been off in the past week and they were unable to participate due to just getting the water back up. July 29 The sixth event occurred on a Friday and was the third event for groups B and D. The event started at 4:00 p.m. and the temperature was 104° F in Boise. Ten pumps opted out. The notification system and communication to the cell devices and DRUs worked as designed. August 8 The seventh event occurred on a Monday and was the fourth event for groups C and D. The event started at 4:00 p.m. and the temperature was 104° F in Boise. Eleven pumps opted out. The notifications to participants went out as designed and the communication to the DRUs and Cell devices occurred without delays. August 9 The eighth event occurred on a Tuesday and was the fourth event for groups A and B. The event started at 4:00 p.m. Temperature was 99° F in Boise. Twenty pumps opted out. The notifications to participants went out as designed and the communication to the DRUs and cell devices occurred without delays. August 17 The ninth event occurred on a Wednesday and was the fifth event for groups B and D. Participating pump locations were eligible for a variable credit payment based on billed kW. The event started at 5:00 p.m. and the temperature in Boise was 103° F. A total of 59 pumps opted out. The notifications to the participants went out as designed and the communication to the DRUs and cell devices occurred without delay. Idaho Power 2022 Irrigation Peak Rewards Program Report Page 9 September 2 The tenth event occurred on a Friday and was the fifth event for groups A and D, and the sixth event for groups B and C. The event started at 4:00 p.m. and the temperature in Boise was 101° F. A total of 35 pumps opted out. The notifications to the participants went out as planned and the communication to the DRUs and cell devices occurred on time. September 6 The eleventh event occurred on a Tuesday and the event was planned for groups A, B and D. However, an emergency event was called due to issues with fires in the vicinity of transmission lines and a problem with one of the generating plants, so group C was also called. This was the sixth event for groups A and D, and the seventh event for groups B and C. Participating pump locations were eligible for a variable credit payment based on billed kW. The event started at 6:00 p.m. for groups A, B, and D and 7:17 p.m. for group C. The temperature in Boise was 101° F. A total of 35 pumps explicitly opted out. The notifications to the participants went out as planned and the communication to the DRUs and cell devices occurred on time. Table 5 shows the percentage of device failures, opt-outs, small load left on, and average MW on during each event. Table 5. Total left on and average MW on during each event Event Date Device Failure Opt Out Small Load Left On Total Left On Average MW On During the Event 7/7/2022 14.3% 3.8% 1.4% 19.5% 36.0 7/12/2022 16.9% 1.5% 0.7% 19.0% 27.1 7/26/2022 4.8% 0.9% 0.4% 6.1% 7.4 7/27/2022 7.5% 0.6% 0.7% 8.8% 14.5 7/28/2022 4.1% 2.3% 0.3% 6.7% 6.7 7/29/2022 7.4% 0.9% 0.8% 9.0% 12.0 8/8/2022 4.8% 0.6% 0.7% 6.1% 6.5 8/9/2022 3.5% 0.9% 0.3% 4.6% 7.2 8/17/2022 2.9% 4.4% 0.4% 7.7% 6.9 9/2/2022 9.2% 1.3% 0.7% 11.2% 32.9 9/6/2022 5.9% 2.1% 0.8% 8.8% 28.2 Percentages are based on load left on during event compared to total nominated MW. Data for participants with meter data errors are interpolated. Potential Realization Rate Analysis The realization rate is used to determine the IPR potential performance for any day during the season. It shows what is on and available for shutoff during a demand response event. For the analysis, the realization rate percentage is reduced by the average of device failures, opt-outs, and small loads left on during an event. These reductions averaged 8.2% for the 2022 season, excluding the first two events where devices were incorrectly categorized. The average of 8.2% was applied to each day 2022 Irrigation Peak Rewards Program Report Idaho Power Page 10 throughout the irrigation season. By removing the average left on, Idaho Power more accurately calculates the potential load reduction for any day during the season. Figure 3 shows the 2022 season participant demand potential realization rate by day (all days except for event days, Sundays, July 4, and Labor Day). The 2022 maximum potential realization rate of 67.3% on July 1st results in a maximum potential load reduction for IPR of 255.6 MW for the 2022 season. The realization rate is typically the highest at the end of June and the beginning of July when a larger percentage of irrigation pumps are operating nearly 24 hours per day, seven days per week. Later in the season, when many pumps are not operating due to crop maturity and reduced watering demands, the potential realization rate is lower. Figure 3. 2022 Participant Demand and Realization Rate (%) Load Reduction Results—Total System Load Data The line graphs presented below show the actual Idaho Power system load in 5-minute intervals for each event day. Due to the size of the program and the groups that were called, it is readily apparent in each graph how the program is impacting overall system load. 32 % 43 % 44 %47 % 42 % 50 %52 %54 % 54 %56 %59 %62 % 62 %64 % 67 % 67 % 62 %65 % 66 % 67 % 64 % 63 % 60 % 61 % 59 % 53 %54 % 53 % 54 % 53 % 50 % 47 % 45 % 45 % 45 % 44 % 44 % 43 % 34 % 42 % 41 % 41 % 40 % 38 % 43 % 42 % 42 % 34 %36 % 40 % 41 % 39 %41 % 38 %40 %42 % 44 % 43 % 40 % 41 % 38 % 37 % 32 % 28 % 24 % 22 % 20 % 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Su m m e d D e m a n d % o f N o m i n a t e d A m o u n t Idaho Power 2022 Irrigation Peak Rewards Program Report Page 11 1,000 1,500 2,000 2,500 3,000 3,500 4,000 7/7/2022 Event 07/07/2022 System Load 1,000 1,500 2,000 2,500 3,000 3,500 4,000 7/12/2022 Event 07/12/2022 System Load 1,000 1,500 2,000 2,500 3,000 3,500 4,000 7/26/2022 Event 07/26/2022 System Load 1,000 1,500 2,000 2,500 3,000 3,500 4,000 7/27/2022 Event 07/27/2022 System Load 1,000 1,500 2,000 2,500 3,000 3,500 4,000 7/28/2022 Event 07/28/2022 System Load 7/29/2022 Event 07/29/2022 System Load 2022 Irrigation Peak Rewards Program Report Idaho Power Page 12 COSTS Program costs totalled $8,503,140 in 2022 with incentives being the largest portion at 92.8%. Incentives paid for the 2022 season totalled $7,895,970, including variable incentives. The participants had six or 1,000 1,500 2,000 2,500 3,000 3,500 4,000 8/8/2022 Event 08/08/2022 System Load 1,000 1,500 2,000 2,500 3,000 3,500 4,000 8/9/2022 Event 08/09/2022 System Load 1,000 1,500 2,000 2,500 3,000 3,500 4,000 8/17/2022 Event 08/17/2022 System Load 1,000 1,500 2,000 2,500 3,000 3,500 4,000 9/2/2022 Event 09/02/2022 System Load 1,000 1,500 2,000 2,500 3,000 3,500 4,000 9/6/2022 Event 09/06/2022 System Load Idaho Power 2022 Irrigation Peak Rewards Program Report Page 13 seven events each and were paid $503,547.59 in variable payments. The estimated maximum cost of variable incentives had the program run for the full 60 hours totalled an additional $1.97 million. Table 6. Annual program costs by category Expense Item 2022 Total Cost Administration ................................................................................................. $ 129,992.54 Marketing ........................................................................................................ 21,601.31 Materials ......................................................................................................... 117,356.40 Services ............................................................................................................ 334,041.83 Evaluation ........................................................................................................ 26,677.50 Other Expenses................................................................................................ (22,500.00) Incentives ........................................................................................................ 7,895,970.71 Total (Actuals) ................................................................................................. $ 8,503,140.29 CONCLUSIONS Highlights from the 2022 season included: • 2,142 service points enrolled • 346,333 kW of enrolled billing demand • Maximum program potential of 255.6 MW including line losses • Event 1: July 7 – actual reduction 121.2 MW including line losses • Event 2: July 12 – actual reduction 109.1 MW including line losses • Event 3: July 26 – actual reduction 113.5 MW including line losses • Event 4: July 27 – actual reduction 76.2 MW including line losses • Event 5: July 28 – actual reduction 102.6 MW including line losses • Event 6: July 29 – actual reduction 76.8 MW including line losses • Event 7: August 8 – actual reduction 83.9 MW including line losses • Event 8: August 9 – actual load reduction 75.1 MW including line losses • Event 9: August 17 – actual load reduction 86.8 MW including line losses • Event 10: September 2 – actual load reduction 155.1 MW including line losses • Event 11: September 6 -- actual load reduction 152.1 MW including line losses • 2,376 active AMI DRUs • 46 active Idaho Power cellular devices 2022 Irrigation Peak Rewards Program Report Idaho Power Page 14 • 9.9% of irrigation service locations were signed up to participate in 2022 • Variable credits for the fifth, sixth, and seventh events totalled $503,547.59 • The actual total cost of having the program this season was $8,503,140 • The estimated cost of running the program for the maximum of 60 hours in 2022 is an additional $1.96 million Idaho Power 2022 Irrigation Peak Rewards Program Report Page 15 Appendix 1. The Demand Reduction Calculation Method Abbreviations ADO—Automatic Dispatch Option AEL—Average Event Load AMI—Automated Metering Infrastructure BL—Baseline Load (Baseline Usage) DR—Demand Reduction MDO—Manual Dispatch Option MV-90—Specific Meter Package with Interval Data Σ—Sum Automatic Dispatch Option Load reduction for each event was calculated using hourly data for each pump using the four hours of each curtailment event was calculated as follows: DRpump = BLpump – AELpump The load reduction for all pumps within a dispatch group is the total hourly reduction for each group as calculated below: DRgroup = Σ DRpump (groups 1-4) +DR(groups) DRnominated (groups) ∗Nominated DRpumps with errors Load reduction for the automatic dispatch option was calculated as follows: DRADO = Σ DRgroup Manual Dispatch Option Data utilized for manual dispatch option participants is AMI hourly usage, MV-90 interval data or data logger interval metering data. Load reduction for manual dispatch option was calculated as follows: DRgroup = Σ DRpump AMI + Σ DRpump MV-90 +DR(groups) DRnominated (groups) ∗Nominated DRpumps with errors The total demand reduction for the Manual Dispatch Option was calculated as follows: DRMDO = Σ DRgroup 2022 Irrigation Peak Rewards Program Report Idaho Power Page 16 The total IPR load reduction was calculated by summing the calculated reduction for the Automatic Dispatch Option sites and the Manual Dispatch Option sites: Total Program DR = DRMDO + DRGroup Historical DSM Expense and Performance 2002–2022 Historical DSM Expense and Performance 2002—2022 Page ii Demand-Side Management 2022 Annual Report Historical DSM Expense and Performance 2002—2022 Demand-Side Management 2022 Annual Report Page 1 Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh)Peak Demand d (MW)Total Utility ($/kWh)Total Resource ($/kWh) Demand Response A/C Cool Credit 2003 ��204 $275,645 $275,645 0�0 2004 ��420 287,253 287,253 0�5 2005 ��2,369 754,062 754,062 3 2006 ��5,369 1,235,476 1,235,476 6 2007 ��13,692 2,426,154 2,426,154 12 2008 ��20,195 2,969,377 2,969,377 26 2009 ��30,391 3,451,988 3,451,988 39 2010 ��30,803 2,002,546 2,002,546 39 2011 ��37,728 2,896,542 2,896,542 24 2012 ��36,454 5,727,994 5,727,994 45 2013 ��n/a 663,858 663,858 n/a 2014 ��29,642 1,465,646 1,465,646 44 2015 ��29,000 1,148,935 1,148,935 36 2016 ��28,315 1,103,295 1,103,295 34 2017 ��28,214 936,272 936,272 29 2018 ��26,182 844,369 844,369 29 2019 ��23,802 877,665 877,665 24 2020 ��22,536 765,020 765,020 19 2021 ��20,846 751,989 751,989 27 2022 ��19,127 829,771 829,771 20 Total��$31,413,857 $31,413,857 Flex Peak Program 2009 ��33 528,681 528,681 19 2010 ��60 1,902,680 1,902,680 48 2011 ��111 2,057,730 2,057,730 59 2012 ��102 3,009,822 3,009,822 53 2013 ��100 2,743,615 2,743,615 48 2014 ��93 1,563,211 1,563,211 40 2015 ��72 592,872 592,872 26 2016 ��137 767,997 767,997 42 2017 ��141 658,156 658,156 36 Historical DSM Expense and Performance 2002—2022 Page 2 Demand-Side Management 2022 Annual Report Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2018 ��140 433,313 433,313 33 2019 ��145 626,823 626,823 31 2020 ��141 542,480 542,480 24 2021 ��139 501,973 501,973 31 2022 ��159 519,618 519,618 25 Total��$16,448,969 $16,448,969 Irrigation Peak Rewards 2004 ��58 344,714 344,714 6 2005 ��894 1,468,282 1,468,282 40 2006 ��906 1,324,418 1,324,418 32 2007 ��947 1,615,881 1,615,881 37 2008 ��897 1,431,840 1,431,840 35 2009 ��1,512 9,655,283 9,655,283 160 2010 ��2,038 13,330,826 13,330,826 250 2011 ��2,342 12,086,222 12,086,222 320 2012 ��2,433 12,423,364 12,423,364 340 2013 ��n/a 2,072,107 2,072,107 n/a 2014 ��2,225 7,597,213 7,597,213 295 2015 ��2,259 7,258,831 7,258,831 305 2016 ��2,286 7,600,076 7,600,076 303 2017 ��2,307 7,223,101 7,223,101 318 2018 ��2,335 6,891,737 6,891,737 297 2019 ��2,332 6,771,708 6,771,708 278 2020 ��2,292 6,407,412 6,407,412 292 2021 ��2,235 7,013,315 7,013,315 255 2022 ��2,142 8,503,140 8,503,140 155 Total��$121,019,471 $121,019,471 Residential Efficiency Ductless Heat Pump Pilot 2009 ��96 202,005 451,605 409,180 18 0�031 0�086 2010 ��104 189,231 439,559 364,000 20 0�044 0�103 2011 ��131 191,183 550,033 458,500 20 0�028 0�081 2012 ��127 159,867 617,833 444,500 20 0�024 0�094 Historical DSM Expense and Performance 2002—2022 Demand-Side Management 2022 Annual Report Page 3 Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2013 ��215 237,575 992,440 589,142 15 0�032 0�132 2014 ��179 251,446 884,211 462,747 15 0�042 0�148 Total��852 $1,231,307 $3,935,681 2,728,069 15 $0.044 $0.138 Easy Savings : Low-Income Energy Efficiency Education 2015 ��2,068 127,477 127,477 624,536 10 0�021 0�021 2016 ��2,001 127,587 127,587 402,961 9 0�035 0�035 2017 ��2,470 149,813 149,813 280,049 8 0�064 0�064 2018 ��282 147,936 147,936 29,610 3 1�370 1�370 2019 ��430 145,494 145,494 45,150 3 0�885 0�885 2020 ��155 9,503 9,503 10,628 3 0�299 0�299 2021 ��0 145,827 145,827 0 3 n/a n/a 2022 ��267 152,718 152,718 22,755 5 1 1 Total��7,673 $1,006,354 $1,006,354 1,415,690 9 $0.097 $0.097 Educational Distributions 2015 ��28,197 432,185 432,185 1,669,495 10 0�026 0�026 2016 ��67,065 2,392,884 2,392,884 15,149,605 10 0�016 0�016 2017 ��84,399 3,466,027 3,466,027 21,187,261 11 0�016 0�016 2018 ��94,717 3,180,380 3,180,380 16,051,888 11 0�019 0�019 2019 ��95,528 2,880,467 2,880,467 10,805,474 11 0�025 0�025 2020 ��97,228 3,106,820 3,106,820 9,481,801 11 0�038 0�038 2021 ��47,027 449,790 449,790 2,931,280 10 0�019 0�019 2022 ��49,136 1,086,813 1,086,813 3,741,954 10 0�037 0�037 Total��563,297 $16,995,365 $16,995,365 81,018,758 11 $0.025 $0.025 Energy Efficiency Packets 2002 ��2,925 755 755 155,757 7 0�001 0�001 Total��2,925 $755 $755 155,757 7 $0.001 $0.001 Energy Efficient Lighting 2002 ��11,618 243,033 310,643 3,299,654 7 0�012 0�015 2003 ��12,662 314,641 464,059 3,596,150 7 0�014 0�021 2004 ��n/a n/a n/a n/a n/a n/a 2005 ��43,760 73,152 107,810 1,734,646 7 0�007 0�010 2006 ��178,514 298,754 539,877 6,302,794 7 0�008 0�014 2007 ��219,739 557,646 433,626 7,207,439 7 0�012 0�017 Historical DSM Expense and Performance 2002—2022 Page 4 Demand-Side Management 2022 Annual Report Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2008 ��436,234 1,018,292 793,265 14,309,444 7 0�011 0�013 2009 ��549,846 1,207,366 1,456,796 13,410,748 5 0�020 0�024 2010 ��1,190,139 2,501,278 3,976,476 28,082,738 5 0�020 0�031 2011 ��1,039,755 1,719,133 2,764,623 19,694,381 5 0�015 0�024 2012 ��925,460 1,126,836 2,407,355 16,708,659 5 0�012 0�025 2013 ��1,085,225 1,356,926 4,889,501 9,995,753 8 0�016 0�058 2014 ��1,161,553 1,909,823 7,148,427 12,882,151 8 0�018 0�066 2015 ��1,343,255 2,063,383 4,428,676 15,876,117 10 0�013 0�028 2016 ��1,442,561 3,080,708 10,770,703 21,093,813 11 0�014 0�049 2017 ��1,766,758 4,872,888 11,078,990 37,765,190 12 0�012 0�026 2018 ��1,340,842 2,435,130 3,277,039 18,856,933 14 0�011 0�014 2019 ��1,336,440 2,126,262 2,782,039 16,245,551 14 0�011 0�014 2020 ��1,148,061 1,667,159 3,065,781 13,942,202 14 0�012 0�022 2021 ��0 43,631 43,631 0 14 n/a n/a 2022 ��370,739 534,982 714,445 1,728,352 15 0�030 0�040 Total��15,603,161 $29,151,022 $61,453,762 262,732,714 9 $0.015 $0.032 Energy House Calls 2002 ��17 26,053 26,053 25,989 20 0�082 0�082 2003 ��420 167,076 167,076 602,723 20 0�023 0�023 2004 ��1,708 725,981 725,981 2,349,783 20 0�025 0�025 2005 ��891 375,610 375,610 1,775,770 20 0�017 0�017 2006 ��819 336,701 336,701 777,244 20 0�035 0�035 2007 ��700 336,372 336,372 699,899 20 0�039 0�039 2008 ��1,099 484,379 484,379 883,038 20 0�045 0�045 2009 ��1,266 569,594 569,594 928,875 20 0�052 0�052 2010 ��1,602 762,330 762,330 1,198,655 20 0�054 0�054 2011 ��881 483,375 483,375 1,214,004 20 0�027 0�027 2012 ��668 275,884 275,884 1,192,039 18 0�016 0�016 2013 ��411 199,995 199,995 837,261 18 0�016 0�016 2014 ��297 197,987 197,987 579,126 18 0�029 0�029 2015 ��362 214,103 214,103 754,646 18 0�020 0�020 2016 ��375 206,437 206,437 509,859 18 0�029 0�029 2017 ��335 183,035 183,035 428,819 16 0�032 0�032 Historical DSM Expense and Performance 2002—2022 Demand-Side Management 2022 Annual Report Page 5 Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2018 ��280 160,777 160,777 374,484 16 0�032 0�032 2019 ��248 161,894 161,894 309,154 16 0�039 0�039 2020 ��51 46,352 46,352 56,944 16 0�075 0�075 2021 ��11 18,257 18,257 14,985 18 0�105 0�105 2022 ��52 38,163 38,163 54,516 19 0�062 0�062 Total��12,493 $5,970,354 $5,970,354 15,567,813 22 $0.033 $0.033 ENERGY STAR® Homes Northwest (gas heated) 2014 �� 282 195,372 22 2015 �� 69 46,872 22 Total��351 $0 $0 242,244 22 Fridge and Freezer Recycling Program 2009 ��1,661 305,401 305,401 1,132,802 8 0�041 0�041 2010 ��3,152 565,079 565,079 1,567,736 8 0�054 0�054 2011 ��3,449 654,393 654,393 1,712,423 8 0�046 0�046 2012 ��3,176 613,146 613,146 1,576,426 8 0�046 0�046 2013 ��3,307 589,054 589,054 1,442,344 8 0�061 0�061 2014 ��3,194 576,051 576,051 1,390,760 6 0�062 0�062 2015 ��1,630 227,179 227,179 720,208 6 0�048 0�048 2016 ��1,539 257,916 257,916 632,186 6 0�062 0�062 2017 ��2,031 265,942 265,942 498,513 6 0�080 0�080 2018 ��304 33,907 33,907 73,602 7 0�061 0�061 Total��23,443 $4,088,069 $4,088,069 10,747,000 7 $0.062 $0.062 Heating & Cooling Efficiency Program 2006 ��17,444 17,444 2007 �� 4 488,211 494,989 1,595 18 27�344 27�710 2008 �� 359 473,551 599,771 561,440 18 0�073 0�092 2009 �� 349 478,373 764,671 1,274,829 18 0�034 0�054 2010 �� 217 327,669 1,073,604 1,104,497 20 0�025 0�083 2011 ��130 195,770 614,523 733,405 20 0�018 0�056 2012 ��141 182,281 676,530 688,855 20 0�018 0�066 2013 ��210 329,674 741,586 1,003,730 20 0�022 0�050 2014 ��230 362,014 1,247,560 1,099,464 20 0�022 0�075 2015 ��427 626,369 2,064,055 1,502,172 20 0�028 0�092 Historical DSM Expense and Performance 2002—2022 Page 6 Demand-Side Management 2022 Annual Report Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2016 ��483 594,913 1,404,625 1,113,574 20 0�040 0�040 2017 ��654 597,198 1,433,357 1,138,744 15 0�041 0�099 2018 ��712 585,211 1,686,618 1,556,065 15 0�029 0�085 2019 ��681 499,179 1,512,183 1,412,183 15 0�028 0�084 2020 ��1,019 606,559 1,911,792 1,839,068 14 0�033 0�103 2021 ��1,048 635,182 2,223,826 1,365,825 15 0�044 0�157 2022 ��1,080 666,016 2,414,026 1,310,260 15 0�050 0�180 Total��7,744 $7,665,614 $20,881,159 17,705,867 17 $0.039 $0.107 Home Energy Audits 2013 ��88,740 88,740 2014 ��354 170,648 170,648 141,077 10 0�150 0�150 2015 ��251 201,957 226,806 136,002 10 0�184 0�184 2016 ��539 289,812 289,812 207,249 11 0�163 0�163 2017 ��524 282,809 353,385 175,010 12 0�146 0�182 2018 ��466 264,394 321,978 211,003 12 0�113 0�137 2019 ��421 230,786 282,215 179,754 11 0�122 0�150 2020 ��97 130,546 142,649 31,938 12 0�448 0�490 2021 ��37 70,448 75,461 3,768 11 2�173 2�328 2022 ��425 184,858 239,783 28,350 11 0�771 1�000 Total��3,114 $1,914,998 $2,191,478 1,114,151 11 $0.203 $0.233 Home Energy Reports Program 2018 ��23,914 194,812 194,812 3,281,780 1 0�046 0�046 2019 ��24,976 200,406 200,406 8,444,746 1 0�018 0�018 2020 ��127,138 899,203 899,203 10,427,940 1 0�081 0�081 2021 ��115,153 970,197 970,197 15,929,074 1 0�057 0�057 2022 ��104,826 964,791 964,791 20,643,379 1 0�044 0�044 Total��396,007 $3,229,408 $3,229,408 58,726,919 1 $0.052 $0.052 Home Improvement Program 2008 ��282 123,454 157,866 317,814 25 0�029 0�037 2009 ��1,188 321,140 550,148 1,338,876 25 0�019 0�032 2010 ��3,537 944,716 2,112,737 3,986,199 45 0�016 0�035 2011 ��2,275 666,041 2,704,816 917,519 45 0�038 0�155 2012 ��840 385,091 812,827 457,353 45 0�044 0�093 Historical DSM Expense and Performance 2002—2022 Demand-Side Management 2022 Annual Report Page 7 Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2013 ��365 299,497 1,061,314 616,044 45 0�025 0�090 2014 ��555 324,717 896,246 838,929 45 0�020 0�055 2015 ��408 272,509 893,731 303,580 45 0�046 0�152 2016 ��482 324,024 1,685,301 500,280 45 0�034 0�177 2017 ��355 166,830 1,345,002 415,824 45 0�021 0�167 2018 ��2,926 2,926 Total��10,287 $3,830,946 $12,222,915 9,692,418 42 $0.026 $0.084 Multifamily Energy Savings Program 2016 ��196 59,046 59,046 149,760 10 0�040 0�040 2017 ��683 168,216 168,216 617,542 11 0�026 0�026 2018 ��764 205,131 205,131 655,953 11 0�030 0�030 2019 ��457 131,306 131,306 346,107 11 0�036 0�036 2020 ��33 89,829 89,829 28,041 11 0�372 0�372 2021 ��0 68,973 68,973 0 11 n/a n/a 2022 ��97 34,181 34,181 41,959 11 0�096 0�096 Total��2,230 $756,682 $756,682 1,839,363 11 $0.049 $0.049 Oregon Residential Weatherization 2002 ��24 -662 23,971 4,580 25 0�010 0�389 2003 ��-943 2004 ��4 1,057 1,057 2005 ��4 612 3,608 7,927 25 0�006 0�034 2006 ��4,126 4,126 2007 ��1 3,781 5,589 9,971 25 0�028 0�042 2008 ��3 7,417 28,752 22,196 25 0�025 0�096 2009 ��1 7,645 8,410 2,907 25 0�203 0�223 2010 ��1 6,050 6,275 320 30 0�011 0�062 2011 ��8 7,926 10,208 21,908 30 0�021 0�027 2012 ��5 4,516 11,657 11,985 30 0�022 0�056 2013 ��14 9,017 14,369 14,907 30 0�035 0�055 2014 ��13 5,462 9,723 11,032 30 0�028 0�050 2015 ��4 5,808 10,388 11,910 30 0�028 0�050 2016 ��7 3,930 5,900 2,847 30 0�079 0�118 2017 ��7 2,384 3,755 2,154 30 0�063 0�099 Historical DSM Expense and Performance 2002—2022 Page 8 Demand-Side Management 2022 Annual Report Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh)Peak Demand d (MW)Total Utility ($/kWh)Total Resource ($/kWh) 2018 ��5 5,507 5,507 2019 ��8 5,982 14,432 2,069 45 0�149 0�360 2020 ��0 5,313 5,313 0 45 n/a n/a 2021 ��0 4,595 4,595 0 45 n/a n/a 2022 ��7 8,825 8,825 0 45 n/a n/a Total��116 $98,348 $186,460 126,713 28 $0.057 $0.108 Rebate Advantage 2003 ��73 27,372 79,399 227,434 45 0�008 0�022 2004 ��105 52,187 178,712 332,587 45 0�010 0�034 2005 ��98 46,173 158,462 312,311 45 0�009 0�032 2006 ��102 52,673 140,289 333,494 45 0�010 0�027 2007 ��123 89,269 182,152 554,018 45 0�010 0�021 2008 ��107 90,888 179,868 463,401 45 0�012 0�025 2009 ��57 49,525 93,073 247,348 25 0�015 0�029 2010 ��35 39,402 66,142 164,894 25 0�018 0�031 2011 ��25 63,469 85,044 159,325 25 0�024 0�033 2012 ��35 37,241 71,911 187,108 25 0�012 0�024 2013 ��42 60,770 92,690 269,891 25 0�014 0�021 2014 ��44 63,231 89,699 269,643 25 0�014 0�020 2015 ��58 85,438 117,322 358,683 25 0�014 0�020 2016 ��66 111,050 148,142 411,272 25 0�016 0�022 2017 ��66 104,996 229,104 214,479 45 0�025 0�055 2018 ��107 147,483 355,115 284,559 45 0�027 0�064 2019 ��109 156,748 355,897 353,615 44 0�023 0�052 2020 ��116 180,422 437,263 366,678 44 0�031 0�075 2021 ��88 173,193 309,790 235,004 45 0�046 0�083 2022 ��97 167,622 402,649 255,541 44 0�043 0�104 Total��1,553 $1,799,154 $3,790,123 6,001,284 39 $0.020 $0.043 Residential New Construction Program (ENERGY STAR® Homes Northwest) 2003 ��13,597 13,597 0 2004 ��44 140,165 335,437 101,200 25 0�103 0�246 2005 ��200 253,105 315,311 415,600 25 0�045 0�056 2006 ��439 469,609 602,651 912,242 25 0�038 0�049 Historical DSM Expense and Performance 2002—2022 Demand-Side Management 2022 Annual Report Page 9 Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2007 ��303 475,044 400,637 629,634 25 0�056 0�047 2008 ��254 302,061 375,007 468,958 25 0�048 0�059 2009 ��474 355,623 498,622 705,784 25 0�039 0�055 2010 ��630 375,605 579,495 883,260 25 0�033 0�051 2011 ��308 259,762 651,249 728,030 32 0�020 0�051 2012 ��410 453,186 871,310 537,447 35 0�046 0�089 2013 ��267 352,882 697,682 365,370 36 0�053 0�104 2014 ��243 343,277 689,021 332,682 36 0�057 0�114 2015 ��598 653,674 1,412,126 773,812 36 0�046 0�099 2016 ��110 142,158 297,518 150,282 36 0�051 0�107 2017 ��277 323,520 603,420 608,292 45 0�029 0�054 2018 ��307 400,912 926,958 777,369 36 0�028 0�064 2019 ��322 534,118 1,411,391 774,597 54 0�035 0�092 2020 ��248 473,504 865,989 649,522 58 0�044 0�081 2021 ��90 247,600 524,876 389,748 61 0�039 0�082 2022 ��109 235,732 578,922 337,562 58 0�045 0�110 Total��5,633 $6,805,133 $12,651,220 10,541,390 36 $0.044 $0.082 Shade Tree Project 2014 ��2,041 147,290 147,290 2015 ��1,925 105,392 105,392 2016 ��2,070 76,642 76,642 2017 ��2,711 195,817 195,817 2018 ��2,093 162,995 162,995 35,571 20 0�307 0�307 2019 ��2,063 147,750 147,750 35,727 30 0�235 0�235 2020 ��0 28,490 28,490 52,662 30 0�038 0�038 2021 ��2,970 184,680 184,680 44,173 40 0�269 0�269 2022 ��1,874 128,856 128,856 39,595 40 0�218 0�218 Total��17,747 $1,177,912 $1,177,912 207,728 32 $0.400 $0.400 Simple Steps, Smart Savings 2007 ��9,275 9,275 0 2008 ��3,034 250,860 468,056 541,615 15 0�044 0�082 2009 ��9,499 511,313 844,811 1,638,038 15 0�031 0�051 2010 ��16,322 832,161 1,025,151 1,443,580 15 0�057 0�070 Historical DSM Expense and Performance 2002—2022 Page 10 Demand-Side Management 2022 Annual Report Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2011 ��15,896 638,323 1,520,977 1,485,326 15 0�034 0�080 2012 ��16,675 659,032 817,924 887,222 14 0�061 0�075 2013 ��13,792 405,515 702,536 885,980 12 0�041 0�071 2014 ��10,061 227,176 302,289 652,129 12 0�031 0�041 2015 ��9,343 139,096 397,898 770,822 10 0�018 0�053 2016 ��7,880 153,784 379,752 577,320 11 0�025 0�063 2017 ��12,556 191,621 484,380 900,171 11 0�020 0�051 2018 ��7,377 90,484 133,101 241,215 12 0�034 0�050 2019 ��5,729 90,499 123,541 271,452 11 0�032 0�043 2020 ��6,894 99,141 98,629 148,404 12 0�073 0�073 Total��135,058 $4,298,280 $7,308,320 10,443,274 13 $0.043 $0.073 Weatherization Solutions for Eligible Customers 2008 ��16 52,807 52,807 71,680 25 0�057 0�057 2009 ��41 162,995 162,995 211,719 25 0�059 0�059 2010 ��47 228,425 228,425 313,309 25 0�056 0�056 2011 ��117 788,148 788,148 1,141,194 25 0�042 0�042 2012 ��141 1,070,556 1,070,556 257,466 25 0�254 0�254 2013 ��166 1,267,791 1,267,791 303,116 25 0�240 0�240 2014 ��118 791,344 791,344 290,926 25 0�163 0�163 2015 ��171 1,243,269 1,243,269 432,958 25 0�175 0�175 2016 ��147 1,323,793 1,323,793 621,653 25 0�130 0�130 2017 ��164 1,108,862 1,121,071 604,733 23 0�115 0�117 2018 ��141 1,022,471 1,022,471 571,741 23 0�112 0�112 2019 ��129 957,626 957,626 504,988 23 0�119 0�119 2020 ��27 208,715 208,715 47,360 23 0�338 0�338 2021 ��7 57,656 57,656 12,591 30 0�317 0�317 2022 ��27 205,788 205,788 48,233 30 0�307 0�307 Total��1,459 $10,490,245 $10,502,454 5,433,667 24 $0.150 $0.150 Window AC Trade Up Pilot 2003 ��99 6,687 10,492 14,454 12 0�051 0�079 Total��99 $6,687 $10,492 14,454 12 $0.052 $0.081 Historical DSM Expense and Performance 2002—2022 Demand-Side Management 2022 Annual Report Page 11 Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) Residential—Weatherization Assistance for Qualified Customers (WAQC) WAQC—Idaho 2002 ��197 235,048 492,139 2003 ��208 228,134 483,369 2004 ��269 498,474 859,482 1,271,677 25 0�029 0�050 2005 ��570 1,402,487 1,927,424 3,179,311 25 0�033 0�045 2006 ��540 1,455,373 2,231,086 2,958,024 25 0�037 0�056 2007 ��397 1,292,930 1,757,105 3,296,019 25 0�029 0�040 2008 ��439 1,375,632 1,755,749 4,064,301 25 0�025 0�032 2009 ��427 1,260,922 1,937,578 4,563,832 25 0�021 0�033 2010 ��373 1,205,446 2,782,597 3,452,025 25 0�026 0�060 2011 ��273 1,278,112 1,861,836 2,648,676 25 0�036 0�052 2012 ��228 1,321,927 1,743,863 621,464 25 0�157 0�208 2013 ��245 1,336,742 1,984,173 657,580 25 0�150 0�223 2014 ��244 1,267,212 1,902,615 509,620 25 0�184 0�276 2015 ��233 1,278,159 2,072,901 529,426 25 0�179 0�290 2016 ��234 1,254,338 1,870,481 722,430 25 0�129 0�192 2017 ��196 1,269,507 1,721,632 654,464 30 0�134 0�182 2018 ��190 1,254,630 1,795,301 641,619 30 0�136 0�194 2019 ��193 1,264,767 1,890,584 639,880 30 0�137 0�205 2020 ��115 1,361,163 1,703,879 218,611 30 0�432 0�540 2021 ��161 1,177,366 1,668,566 289,353 30 0�253 0�371 2022 ��147 1,277,717 2,024,735 272,647 30 0�338 0�535 Total��5,879 $24,296,086 $36,467,095 31,190,960 25 $0.060 $0.089 WAQC—Oregon 2002 ��31 24,773 47,221 68,323 25 0�027 0�051 2003 ��29 22,255 42,335 102,643 25 0�016 0�031 2004 ��17 13,469 25,452 28,436 25 0�035 0�067 2005 ��28 44,348 59,443 94,279 25 0�035 0�047 2006 ��25 2007 ��11 30,694 41,700 42,108 25 0�054 0�074 2008 ��14 43,843 74,048 73,841 25 0�040 0�068 2009 ��10 33,940 46,513 114,982 25 0�023 0�031 Historical DSM Expense and Performance 2002—2022 Page 12 Demand-Side Management 2022 Annual Report Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2010 ��27 115,686 147,712 289,627 25 0�030 0�038 2011 ��14 46,303 63,981 134,972 25 0�025 0�035 2012 ��10 48,214 76,083 26,840 25 0�133 0�210 2013 ��9 54,935 67,847 24,156 25 0�168 0�208 2014 ��11 52,900 94,493 24,180 25 0�162 0�289 2015 ��10 36,873 46,900 20,595 25 0�133 0�169 2016 ��12 35,471 63,934 23,732 25 0�111 0�199 2017 ��7 37,978 61,052 15,074 30 0�175 0�281 2018 ��3 18,344 24,191 7,886 30 0�161 0�213 2019 ��4 38,960 62,905 9,419 30 0�287 0�463 2020 ��0 24,414 24,414 0 30 2021 ��1 9,473 21,586 1,752 30 0�375 0�854 2022 ��0 3,778 3,778 0 Total��248 $736,649 $1,095,587 1,102,845 25 $0.051 $0.076 WAQC—BPA Supplemental 2002 ��75 55,966 118,255 311,347 25 0�013 0�028 2003 ��57 49,895 106,915 223,591 25 0�017 0�036 2004 ��40 69,409 105,021 125,919 25 0�041 0�062 Total��172 $175,270 $330,191 660,857 25 $0.020 $0.037 WAQC Total ��6,152 $23,926,511 $35,864,361 32,682,015 25 $0.058 $0.088 Commercial Air Care Plus Pilot 2003 ��4 5,764 9,061 33,976 10 0�021 0�033 2004 ��344 344 Total��4 $6,108 $9,405 33,976 10 $0.023 $0.035 Commercial Energy-Saving Kits (Commercial Education Initiative) 2005 ��3,497 3,497 2006 ��4,663 4,663 2007 ��26,823 26,823 2008 ��72,738 72,738 2009 ��120,584 120,584 2010 ��68,765 68,765 2011 ��89,856 89,856 Historical DSM Expense and Performance 2002—2022 Demand-Side Management 2022 Annual Report Page 13 Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2012 ��73,788 73,788 2013 ��66,790 66,790 2014 ��76,606 76,606 2015 ��65,250 65,250 2016 �� 2017 �� 2018 ��1,652 146,174 146,174 442,170 10 0�034 0�034 2019 ��2,629 161,945 161,945 569,594 10 0�029 0�029 2020 ��1,379 103,678 103,678 258,368 11 0�047 0�047 2021 ��906 74,617 74,617 296,751 11 0�029 0�029 2022 ��334 22,770 22,770 48,758 10 0�059 0�059 Total��6,900 $1,178,544 $1,178,544 1,615,641 10 $0.092 $0.092 New Construction 2004 ��28,821 28,821 2005 ��12 194,066 233,149 494,239 12 0�043 0�052 2006 ��40 374,008 463,770 704,541 12 0�058 0�072 2007 ��22 669,032 802,839 2,817,248 12 0�015 0�040 2008 ��60 1,055,009 1,671,375 6,598,123 12 0�017 0�028 2009 ��72 1,327,127 2,356,434 6,146,139 12 0�024 0�043 2010 ��70 1,509,682 3,312,963 10,819,598 12 0�016 0�035 2011 ��63 1,291,425 3,320,015 11,514,641 12 0�010 0�026 2012 ��84 1,592,572 8,204,883 20,450,037 12 0�007 0�036 2013 ��59 1,507,035 3,942,880 10,988,934 12 0�012 0�032 2014 ��69 1,258,273 3,972,822 9,458,059 12 0�012 0�037 2015 ��81 2,162,001 6,293,071 23,232,017 12 0�008 0�024 2016 ��116 1,931,222 4,560,826 12,393,249 12 0�014 0�033 2017 ��121 2,433,596 4,265,056 17,353,820 12 0�013 0�022 2018 ��104 2,069,645 5,054,215 13,378,315 12 0�014 0�034 2019 ��168 3,548,476 5,292,835 20,640,334 12 0�015 0�023 2020 ��119 2,383,983 4,175,611 14,565,936 12 0�018 0�031 2021 ��95 2,691,171 4,160,999 17,536,004 12 0�017 0�026 2022 ��88 2,780,507 3,641,930 27,615,777 12 0�011 0�015 Total��1,443 $30,807,651 $65,754,495 226,707,011 12 $0.015 $0.032 Historical DSM Expense and Performance 2002—2022 Page 14 Demand-Side Management 2022 Annual Report Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) Retrofits 2006 ��31,819 31,819 2007 ��104 711,494 1,882,035 5,183,640 0�8 12 0�015 0�040 2008 ��666 2,992,261 10,096,627 25,928,391 4�5 12 0�013 0�043 2009 ��1,224 3,325,505 10,076,237 35,171,627 6�1 12 0�011 0�032 2010 ��1,535 3,974,410 7,655,397 35,824,463 7�8 12 0�013 0�024 2011 ��1,732 4,719,466 9,519,364 38,723,073 12 0�011 0�022 2012 ��1,838 5,349,753 9,245,297 41,568,672 12 0�012 0�020 2013 ��1,392 3,359,790 6,738,645 21,061,946 12 0�014 0�029 2014 ��1,095 3,150,942 5,453,380 19,118,494 12 0�015 0�025 2015 ��1,222 4,350,865 7,604,200 23,594,701 12 0�017 0�029 2016 ��1,577 5,040,190 8,038,791 28,124,779 12 0�016 0�026 2017 ��1,137 4,343,835 12,500,303 23,161,877 12 0�017 0�049 2018 ��1,358 5,990,179 16,253,716 34,910,707 12 0�015 0�042 2019 ��1,033 6,281,056 17,700,769 42,674,418 12 0�013 0�037 2020 ��630 3,587,277 11,964,431 20,965,215 12 0�019 0�063 2021 ��787 3,826,750 11,486,766 21,181,022 12 0�020 0�059 2022 ��525 4,870,916 13,402,016 22,890,679 12 0�024 0�065 Total��17,855 $65,906,507 $159,697,439 440,083,703 12 $0.017 $0.041 Holiday Lighting 2008 ��14 28,782 73,108 259,092 10 0�014 0�035 2009 ��32 33,930 72,874 142,109 10 0�031 0�066 2010 ��25 46,132 65,308 248,865 10 0�024 0�034 2011 ��6 2,568 2,990 66,189 10 0�004 0�005 Total��77 $111,412 $214,280 716,255 10 $0.020 $0.038 Oregon Commercial Audit 2002 ��24 5,200 5,200 2003 ��21 4,000 4,000 2004 ��7 0 0 2005 ��7 5,450 5,450 2006 ��6 2007 ��1,981 1,981 2008 ��58 58 Historical DSM Expense and Performance 2002—2022 Demand-Side Management 2022 Annual Report Page 15 Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2009 ��41 20,732 20,732 2010 ��22 5,049 5,049 2011 ��12 13,597 13,597 2012 ��14 12,470 12,470 2013 ��18 5,090 5,090 2014 ��16 9,464 9,464 2015 ��17 4,251 4,251 2016 ��7 7,717 7,717 2017 ��13 8,102 8,102 2018 ��0 1,473 1,473 2019 ��11 7,262 7,262 2020 ��2 1,374 1,374 2021 ��3 4,401 4,401 2022 ��12 7,493 7,493 Total��253 $125,164 $125,164 Oregon School Efficiency 2005 ��86 86 2006 ��6 24,379 89,771 223,368 12 0�012 0�044 Total��6 $24,465 $89,857 223,368 12 $0.012 $0.044 Small Business Direct Install 2020 ��139 339,830 339,830 780,260 9 0�058 0�058 2021 ��452 1,032,056 1,032,056 2,421,842 11 0�062 0�062 2022 ��680 1,345,429 1,345,429 3,228,366 11 0�049 0�049 Total��1,271 $2,717,315 $2,717,315 6,430,468 5 $0.091 $0.091 Industrial Custom Projects 2003 ��1,303 1,303 2004 ��1 112,311 133,441 211,295 12 0�058 0�069 2005 ��24 1,128,076 3,653,152 12,016,678 12 0�010 0�033 2006 ��40 1,625,216 4,273,885 19,211,605 12 0�009 0�024 2007 ��49 3,161,866 7,012,686 29,789,304 3�6 12 0�012 0�026 2008 ��101 4,045,671 16,312,379 41,058,639 4�8 12 0�011 0�044 2009 ��132 6,061,467 10,848,123 51,835,612 6�7 12 0�013 0�024 Historical DSM Expense and Performance 2002—2022 Page 16 Demand-Side Management 2022 Annual Report Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2010 ��223 8,778,125 17,172,176 71,580,075 9�5 12 0�014 0�027 2011 ��166 8,783,811 19,830,834 67,979,157 7�8 12 0�012 0�026 2012 ��126 7,092,581 12,975,629 54,253,106 7�6 12 0�012 0�021 2013 ��73 2,466,225 5,771,640 21,370,350 2�4 12 0�010 0�024 2014 ��131 7,173,054 13,409,922 50,363,052 5�6 12 0�013 0�024 2015 ��160 9,012,628 20,533,742 55,247,192 6�3 11 0�016 0�035 2016 ��196 7,982,624 16,123,619 47,518,871 16 0�013 0�026 2017 ��170 8,679,919 17,279,117 44,765,354 16 0�015 0�029 2018 ��248 8,808,512 16,112,540 46,963,690 16 0�014 0�026 2019 ��257 11,879,873 24,590,176 70,433,920 15 0�013 0�027 2020 ��169 18,059,396 41,604,451 94,006,717 15 0�018 0�042 2021 ��135 8,608,903 22,552,383 53,728,267 13 0�017 0�044 2022 ��106 8,919,927 25,715,468 56,157,060 13 0�017 0�049 Total��2,507 $132,381,486 $295,904,345 888,489,944 13 $0.016 $0.035 Green Motors Rewind—Industrial 2016 ��14 123,700 7 2017 ��13 143,976 7 2018 ��25 64,167 7 2019 ��12 117,223 8 2020 ��10 56,012 8 2021 ��4 12,172 20,430 8 2022 ��9 3,424 19,851 8 Total��87 $0 $15,596 545,358 7 Irrigation Irrigation Efficiency Rewards 2003 ��2 41,089 54,609 36,792 0�0 15 0�106 0�141 2004 ��33 120,808 402,978 802,812 0�4 15 0�014 0�048 2005 ��38 150,577 657,460 1,012,883 0�4 15 0�014 0�062 2006 ��559 2,779,620 8,514,231 16,986,008 5�1 8 0�024 0�073 2007 ��816 2,001,961 8,694,772 12,304,073 3�4 8 0�024 0�103 2008 ��961 2,103,702 5,850,778 11,746,395 3�5 8 0�026 0�073 2009 ��887 2,293,896 6,732,268 13,157,619 3�4 8 0�026 0�077 2010 ��753 2,200,814 6,968,598 10,968,430 3�3 8 0�030 0�096 Historical DSM Expense and Performance 2002—2022 Demand-Side Management 2022 Annual Report Page 17 Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2011 ��880 2,360,304 13,281,492 13,979,833 3�8 8 0�020 0�113 2012 ��908 2,373,201 11,598,185 12,617,164 3�1 8 0�022 0�110 2013 ��995 2,441,386 15,223,928 18,511,221 3�0 8 0�016 0�098 2014 ��1,128 2,446,507 18,459,781 18,463,611 4�6 8 0�016 0�119 2015 ��902 1,835,711 9,939,842 14,027,411 1�6 8 0�016 0�085 2016 ��851 2,372,352 8,162,206 15,673,513 8 0�018 0�063 2017 ��801 2,475,677 8,382,962 16,824,266 8 0�018 0�060 2018 ��1,022 2,953,706 11,948,469 18,933,831 8 0�019 0�076 2019 ��1,080 2,661,263 10,042,514 10,073,455 8 0�032 0�120 2020 ��1,018 3,401,673 16,857,055 12,847,823 15 0�025 0�125 2021 ��1,019 2,607,200 19,138,043 9,680,497 19 0�023 0�166 2022 ��519 2,080,027 14,083,686 6,937,855 18 0�027 0�179 Total��15,172 $41,701,474 $194,989,441 235,585,492 9 $0.024 $0.113 Green Motors Rewind—Irrigation 2016 ��23 73,617 19 2017 ��27 63,783 19 2018 ��26 67,676 19 2019 ��34 44,705 20 2020 ��23 36,147 20 2021 ��12 87,254 19,352 21 2022 ��6 5,634 16,951 23 Total��151 $0 $92,888 322,230 20 Other Programs Building Operator Training 2003 ��71 48,853 48,853 1,825,000 5 0�006 0�006 2004 ��26 43,969 43,969 650,000 5 0�014 0�014 2005 ��7 1,750 4,480 434,167 5 0�001 0�002 Total��104 94,572 97,302 2,909,167 5 0.007 0.007 Comprehensive Lighting 2011 ��2,404 2,404 2012 ��64,094 64,094 Total��$66,498 $66,498 Historical DSM Expense and Performance 2002—2022 Page 18 Demand-Side Management 2022 Annual Report Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) Distribution Efficiency Initiative 2005 ��21,552 43,969 2006 ��24,306 24,306 2007 ��8,987 8,987 2008 ��-1,913 -1,913 Total��$52,932 $75,349 DSM Direct Program Overhead 2007 ��56,909 56,909 2008 ��169,911 169,911 2009 ��164,957 164,957 2010 ��117,874 117,874 2011 ��210,477 210,477 2012 ��285,951 285,951 2013 ��380,957 380,957 2014 ��478,658 478,658 2015 ��272,858 272,858 2016 ��293,039 293,039 2017 ��1,759,352 1,759,352 2018 ��1,801,955 1,801,955 2019 ��2,119,820 2,119,820 2020 ��1,811,869 1,811,869 2021 ��2,226,910 2,226,910 2022 ��2,795,885 2,795,885 Total��$14,947,383 $14,947,383 Local Energy Efficiency Fund 2003 ��56 5,100 5,100 2004 ��23,449 23,449 2005 ��2 14,896 26,756 78,000 10 0�024 0�042 2006 ��480 3,459 3,459 19,027 7 0�009 0�009 2007 ��1 7,520 7,520 9,000 7 0�135 0�135 2008 ��2 22,714 60,100 115,931 0�0 15 0�019 0�049 2009 ��1 5,870 4,274 10,340 0�0 12 0�064 0�047 2010 ��1 251 251 0�0 Historical DSM Expense and Performance 2002—2022 Demand-Side Management 2022 Annual Report Page 19 Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2011 ��1 1,026 2,052 2,028 30 0�035 0�070 2012 �� 2013 �� 2014 ��1 9,100 9,100 95,834 18 Total��545 $93,385 $142,061 330,160 14 $0.029 $0.044 Other C&RD and CRC BPA 2002 ��55,722 55,722 2003 ��67,012 67,012 2004 ��108,191 108,191 2005 ��101,177 101,177 2006 ��124,956 124,956 2007 ��31,645 31,645 2008 ��6,950 6,950 Total��$495,654 $495,654 Residential Economizer Pilot 2011 ��101,713 101,713 2012 ��93,491 93,491 2013 ��74,901 74,901 Total��$270,105 $270,105 Residential Education Initiative 2005 ��7,498 7,498 2006 ��56,727 56,727 2007 �� 2008 ��150,917 150,917 2009 ��193,653 193,653 2010 ��222,092 222,092 2011 ��159,645 159,645 2012 ��174,738 174,738 2013 ��416,166 416,166 2014 ��6,312 423,091 423,091 1,491,225 11 2015 ��149,903 149,903 2016 ��290,179 290,179 2017 ��223,880 223,880 Historical DSM Expense and Performance 2002—2022 Page 20 Demand-Side Management 2022 Annual Report Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh)Peak Demand d (MW)Total Utility ($/kWh)Total Resource ($/kWh) 2018 ��172,215 172,215 2019 ��160,851 160,851 2020 ��223,731 223,731 2021 ��483,067 483,067 2022 ��300,175 300,175 Total��$3,808,528 $3,808,528 1,491,225 Solar 4R Schools 2009 ��45,522 45,522 Total��$45,522 $45,522 Market Transformation Consumer Electronic Initiative 2009 ��160,762 160,762 Total��$160,762 $160,762 NEEA 2002 ��1,286,632 1,286,632 12,925,450 2003 ��1,292,748 1,292,748 11,991,580 2004 ��1,256,611 1,256,611 13,329,071 2005 ��476,891 476,891 16,422,224 2006 ��930,455 930,455 18,597,955 2007 ��893,340 893,340 28,601,410 2008 ��942,014 942,014 21,024,279 2009 ��968,263 968,263 10,702,998 2010 ��2,391,217 2,391,217 21,300,366 2011 ��3,108,393 3,108,393 20,161,728 2012 ��3,379,756 3,379,756 19,567,984 2013 ��3,313,058 3,313,058 20,567,965 2014 ��3,305,917 3,305,917 26,805,600 2015 ��2,582,919 2,582,919 23,038,800 2016 ��2,676,387 2,676,387 24,352,800 2017 ��2,698,756 2,698,756 24,440,400 2018 ��2,500,165 2,500,165 25,666,800 2019 ��2,721,070 2,721,070 18,368,135 2020 ��2,789,210 2,789,210 17,614,323 Historical DSM Expense and Performance 2002—2022 Demand-Side Management 2022 Annual Report Page 21 Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2021 ��2,977,678 2,977,678 16,818,788 2022 1 ��2,789,937 2,789,937 24,448,132 Total��$45,281,416 $45,281,416 416,746,789 Annual Totals 2002 ��1,932,520 2,366,591 16,791,100 0�0 2003 ��2,566,228 3,125,572 18,654,343 0�0 2004 ��3,827,213 4,860,912 19,202,780 6�5 2005 ��6,523,348 10,383,577 37,978,035 43�9 2006 ��11,174,181 20,950,110 67,026,303 43�6 2007 ��14,896,816 27,123,018 91,145,357 57�9 2008 ��20,213,216 44,775,829 128,508,579 74�3 2009 ��33,821,062 53,090,852 143,146,365 235�5 2010 ��44,643,541 68,981,324 193,592,637 357�7 2011 ��44,877,117 79,436,532 183,476,312 415�2 2012 ��47,991,350 77,336,341 172,054,327 448�8 2013 ��26,100,091 54,803,353 109,505,690 54�5 2014 ��35,648,260 71,372,414 145,475,713 389�7 2015 ��37,149,893 70,467,082 162,533,155 374�5 2016 ��40,499,570 70,984,604 170,792,152 379�0 2017 ��44,828,089 78,799,054 191,471,395 383�0 2018 ��42,926,872 75,797,483 184,078,634 358�7 2019 ��47,390,056 83,661,890 203,301,810 332�5 2020 ��49,354,064 100,230,772 198,432,599 336�0 2021 ��37,056,897 79,194,093 142,920,507 312�8 2022 ��41,456,433 82,964,848 169,888,530 199�7 Total Direct Program ��$634,880,818 $1,161,313,482 2,751,640,723 Indirect Program Expenses DSM Overhead and Other Indirect 2002 ��128,855 2003 ��-41,543 2004 ��142,337 2005 ��177,624 2006 ��309,832 Historical DSM Expense and Performance 2002—2022 Page 22 Demand-Side Management 2022 Annual Report Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2007 ��765,561 2008 ��980,305 2009 ��1,025,704 2010 ��1,189,310 2011 ��1,389,135 2012 ��1,335,509 2013 ��$741,287 2014 ��1,065,072 2015 ��1,891,042 2016 ��2,263,893 2017 ��2,929,407 2018 ��1,335,208 2019 ��1,194,640 2020 ��1,202,238 2021 ��1,296,605 2022 ��1,507,146 Total��$$22,829,168 Total Expenses 2002 ��2,061,375 2003 ��2,528,685 2004 ��3,969,550 2005 ��6,700,972 2006 ��11,484,013 2007 ��15,662,377 2008 ��21,193,521 2009 ��34,846,766 2010 ��45,832,851 2011 ��46,266,252 2012 ��49,326,859 2013 ��26,841,378 2014 ��36,713,333 2015 ��39,040,935 2016 ��42,763,463 Historical DSM Expense and Performance 2002—2022 Demand-Side Management 2022 Annual Report Page 23 Total Costs Savings and Demand Reductions Measure Life (Years) Levelized Costs a Program/Year Participants Utility Cost b Resource Cost c Annual Energy (kWh) Peak Demand d (MW) Total Utility ($/kWh) Total Resource ($/kWh) 2017 ��47,757,496 2018 ��44,262,080 2019 ��48,584,696 2020 ��50,556,303 2021 ��38,353,503 2022 ��42,963,579 Total 2002–2022 ��$657,709,986 a Levelized Costs are based on financial inputs from Idaho Power’s 2019 Second Amended Integrated Resource Plan and calculations include line loss adjusted energy savings. b The Total Utility Cost is all cost incurred by Idaho Power to implement and manage a DSM program. c The Total Resource Cost is the total expenditures for a DSM program from the point of view of Idaho Power and its customers as a whole. d Peak Demand is reported for programs that directly reduce load or measure demand reductions during summer peak season. Peak demand reduction for demand response programs is reported at the generation level assuming 9.7% peak line losses. 1 Savings are preliminary estimates provided by NEEA. Final savings for 2022 will be provided by NEEA April 2023. Historical DSM Expense and Performance 2002—2022 Page 24 Demand-Side Management 2022 Annual Report 22 Student Energy Efficiency Kit Program Designed and implemented by Tinker LLC SCHOOL YEAR 2021-2022ANNUAL REPORT STUDENT ENERGY EFFICIENCY KIT PROGRAM Joseph Thrasher MESSAGE FROM TINKER LLC Dear Denise, We wanted to take a moment to express our appreciation and gratitude for selecting Tinker to deliver IPC's Student Energy Efficiency Kit Program. We thoroughly enjoyed working with the teachers, students, and parents within your service area. This was such a great group of people to work with! We truly appreciate your support and are excited to continue as your preferred vendor for years to come. Thanks again! Cheerfully, Joseph Thrasher TABLE OF CONTENTS INTRODUCTION Message from Tinker LLC 2 OVERVIEW Executive Summary 4 DESCRIPTION Program Description 6 OPERATIONS Program Timeline 8 Program Materials 9 Program Content 12 Energy Efficiency Kits 13 Student Competitions 14 Teacher Recruitment 16 OUTCOMES School Participation 17 Projected Savings 18 Student Assessments 20 Student Pledges 22 Student Survey 23 Teacher Evaluations 26 Teacher Mini-Grants 28 Continuous Improvement 29 APPENDICES Appendix A Student Kit Savings Calculations 30 Appendix B Teacher Kit Savings Calculations 37 Appendix C Participation Tables 38 Appendix D Participant Letters 50 4 Tinker LLC is pleased to submit this annual report describing the implementation and outcomes of the Student Energy Efficiency Kit Program ("SEEK"). From August 2021 through June 2022, Tinker LLC supported the energy efficiency education efforts in Idaho and Oregon through a partnership with Idaho Power Company ("IPC"). The program was developed to educate students in IPC's service area about energy efficiency through the implementation of a locally-based education program within schools. Tinker LLC and IPC staff developed curriculum that included lessons, STEM activities, digital program resources, student contests, teacher grants, and an Energy Efficiency Kit containing energy-saving devices for each student. The Student Energy Efficiency Kit Program is known and marketed to the schools as the EnergyWise Program. Program objectives included the following: • Leverage classroom teachers from schools within IPC’s service area to provide their 4th – 6th grade students with quality, age-appropriate instruction regarding the wise use of electricity. • Encourage the wise use of electricity at home by engaging students and their families in activities that support and reinforce energy efficiency and conservation concepts. • Provide age-appropriate tools to facilitate student participation and incentives to encourage follow through for all Program participants, i.e., teachers, students, and parents. • Cross-market IPC’s other residential energy efficiency programs as directed by IPC. • Provide IPC with annual energy savings information in the form of an annual program summary report based on student responses. • Enhance IPC’s brand as a trusted energy advisor. • Maintain or enhance IPC’s customer satisfaction. School Year 2021-2022 STUDENT ENERGY EFFICIENCY KIT PROGRAMEXECUTIVE SUMMARY 174 schools participated By the Numbers 338 teachers participated 12,257 students enrolled 188.02kWh per student kit distributed 132.40 kWh per teacher kit distributed 2,349,367 kWh saved annually 5 Tinker LLC managed all aspects of the program design and implementation, including school recruitment, lesson development, day-to-day program management, and reporting. Below are the program outcomes: 1. Curriculum. To support educational goals, Tinker worked with IPC staff to develop six lessons specifically for Idaho Power students. Each lesson included locally-based information, teacher resources, hands-on activities, and supported Idaho state education standards. Below is the list of lessons developed: • Natural Resources • Electric Energy • Energy-Water Nexus • Peak and Off-Peak Time • Electric Bill • Efficiency and Conservation 2. School Participation. During the school year 2021-2022, 174 schools, representing 338 teachers and 12,257 students participated in the program. Each of these students received an Energy Efficiency Kit and access to digital learning resources. 3. Knowledge Retention. To determine the baseline knowledge, students were asked to complete a 10-question assessment before the program was introduced. After completing the lessons, they completed a post-program assessment to determine the knowledge gained through the program. The average pre-assessment test score was 66%. After completing the lessons, the average test score was 87%--an increase of 21%. 4. Energy Efficiency Kits. A take-home Energy Efficiency Kit was provided to 12,257 students and 338 teachers. Each contained products that can be used at home to conserve water and energy. Students work with their parents to use the products and report on their actions. 5. Student Survey. At the close of the program, students are asked to complete a survey detailing the actions they took and which products from the Energy Efficiency Kit they installed. Surveys were received from 7,720 students. Based on the reported data, projected savings from kits can be found below. Electricity Natural Gas Water Green House Gas Reduction Annual savings per student kit:188.02 kWh 3.44 Therms 1,408.11 Gals 0.15 Metric Tons Annual savings per teacher kit:132.40 kWh 2.42 Therms 991.51 Gals 0.11 Metric Tons Annual program savings:2,349,367 kWh 42,995 Therms 17,594,315 Gals 1,893.45 Metric Tons Lifetime program savings:18,405,454 kWh 429,947 Therms 175,943,147 Gals 15,318.73 Metric Tons *The algorithms and data used for these calculations can be found in Appendix A & B 6 School Year 2021-2022 STUDENT ENERGY EFFICIENCY KIT PROGRAMDESCRIPTION The Student Energy Efficiency Kit Program is a locally-based curriculum designed to teach fourth-, fifth-, and sixth-grade school students about energy and how to use it wisely. Offered as a completely turnkey program, Tinker managed all aspects of the program implementation. Tinker designed and customized three lessons appropriate for fourth-, fifth-, and sixth-grade students attending schools in IPC's service territory. Next, Tinker contacted fourth-, fifth-, and sixth-grade teachers using a variety of communication tools to introduce the program and collect enrollment commitments. Participating teachers, students, and parents were then provided access to Tinker’s online platform or web application. Program Delivery Delivered by classroom teachers, the curriculum fit seamlessly within the current classroom setting. The curriculum included lessons that were designed to support Idaho and Oregon state education standards, featured engaging digital content, and included hands-on activities. Moreover, each lesson included resources such as video streaming content, online assessments, and more. Using resources from our web application, teachers delivered the curriculum to their students. Students and parents were also provided access to the web application, which included portals designed specifically for each participating segment. IPC was provided with its own customized version of the web application that displayed its logo at the top of each page and referenced it throughout the pages. I love the online portion compared to the workbook in previous years. V. Medda, Teacher Summit Elementary School "" 7 The digital delivery of the program through the web application allowed for: • Program Tracking. All program actions were tracked and recorded in real-time. The data was analyzed and used to inform unique actions by program staff and published within an on-line dashboard. IPC staff was supplied credentials to access the dashboard and encouraged to follow program progress. • Additional Engagement Opportunities. Other IPC related programs were promoted within each relevant portal. Upon completion of the lessons, students acquired new knowledge of energy efficiency, and each student was provided an Energy Efficiency Kit containing energy-saving devices. During the final lesson, students completed exercises using the devices included in the kit, giving their families an opportunity to immediately and consistently conserve water and energy. Throughout the program, students completed simple surveys and assessments. This data was collected, analyzed, and summarized to gauge the curriculum’s impact on students. At the close of the unit, students and parents completed a pledge to continue to conserve energy and water. At the end of the school year, all data generated from the lessons and any predefined success metrics were collected to present in this Final Report. I loved that the program provided education on energy usage and awareness for the students and made it applicable for them to participate in conserving and efficiency. K. Platt, Teacher Heights Elementary School " " 8 School Year 2021-2022 STUDENT ENERGY EFFICIENCY KIT PROGRAMPROGRAM TIMELINE Aug Sep Oct Nov Dec Jan Feb Mar Apr May June Ph a s e 1 : L a u n c h Branding information provided Incentive programs developed Print & digital materials published Quality control checks performed Eligible school information identified Ph a s e 2 : I m p l e m e n t a t i o n Teachers introduced to the program Participation commitments collected Access to digital materials granted Materials and Kits shipped Communication with teachers Collection & evaluation of program data Ph a s e 3 : Re p o r t i n g Program closed to participation Program data compiled and analyzed Final report developed and delivered 9 Phase 1: Launch STUDENT ENERGY EFFICIENCY KIT PROGRAMPROGRAM MATERIALS During the program, teachers, students, and parents were provided with a variety of resources expertly designed to educate about energy efficiency and encourage energy efficient behaviors. These resources, including the web application, a printed teacher guide, parent letter, and online lesson materials, were customized to feature the IPC logo and brand. Each are described on the following pages and below. DIGITAL MATERIALS Parents of participating students were provided access to the parent portal through the web application. The available resources included the following. • A parent letter describing the program, its goals, and the energy efficiency opportunities available • Additional energy efficiency resources offered by IPC • Program evaluation PARENT PROGRAM RESOURCES I loved that my students were able to take this activity home with the student kits. It helped with engagement and parent involvement. A. Crisp, Teacher Central Elementary School " " 10 SUPPORTING PHYSICAL MATERIALS Participating teachers were provided a printed Teacher Guide to support the digital resources. The Teacher Guide included the following: • Program goals • Instructions to administer the program • Unit plan • Lesson plans • Contest and mini-grant information • Answer keys TEACHER PROGRAM RESOURCES DIGITAL MATERIALS Teachers were provided access to the teacher portal through the web application. The available resources included the following. • Instructions to guide teachers through the administration of the program • Supported Idaho state education standards • Letter to parents in English and Spanish • Lesson materials including: o Lesson plans o Digital slides for classroom presentations o Online resources o Video content o Online homework exercises o Assessments • Post-program Evaluation • Student progress reporting 11 DIGITAL MATERIALS Students were provided access to the student portal within the web application. Resources available included the following: • Instructions for installing the products inside the kits • Access to digital lessons and assessments • Video contest information • The student leader board • Additional energy efficiency information STUDENT PROGRAM RESOURCES SUPPORTING PHYSICAL MATERIALS Participating students were provided a student workbook to support the digital resources. The student workbook included the following: • Classroom activity worksheets • Classroom assessments • The Energy Efficiency Kit product installation guide and data collection forms 12 Phase 2: Implementation STUDENT ENERGY EFFICIENCY KIT PROGRAMPROGRAM CONTENT The Student Energy Efficiency Kit Program curriculum was designed to build upon and supplement fourth-, fifth-, and sixth-grade science, math, and language arts curriculum. The curriculum included the following: Locally-Based Content: To support educational goals, Tinker worked with IPC staff to develop six lessons specifically for students. Each lesson included locally-based information and supported Idaho state education standards. Below is the list of lessons we developed: • Natural Resources • Electric Energy • Energy-Water Nexus • Peak and Off-Peak Time • Electric Bill • Efficiency and Conservation To support each lesson, Tinker worked with IPC staff to include teaching resources, video resources, hans-on activities, and homework exercises in the lessons. At the conclusion of each classroom lesson, teachers had the option of assigning online homework exercises that reviewed the content taught in the classroom. Tinker worked with IPC staff to develop each homework exercise. These exercises included locally-based video content, interactive activities, labeled graphics, flash card grids, and more. The extensive information in each exercise was designed to be engaging and to maximize the knowledge retention of the student. Web Application The program activities were great. I would love to have more, easy to use stem activities tosupport the information. K. Strawser, Teacher Melba Elementary School " " 13 Phase 2: Implementation STUDENT ENERGY EFFICIENCY KIT PROGRAMENERGY EFFICIENCY KIT A take-home Energy Efficiency Kit was provided to 338 teachers and 12,257 students. Each contained products that can be used at home to conserve water and energy. Students work with their parents to use the products and report on their actions. Each kit contained the following items: • Showerhead• Three LED Lightbulbs • LED Night Light • Shower Timer • Digital Thermometer • Filter Whistle• Water Flow Rate Bag • Quick Start Guide • Water Bottle Decals Energy Efficiency Kit 14 Phase 2: Implementation STUDENT ENERGY EFFICIENCY KIT PROGRAMSTUDENT COMPETITIONS A fun component of the Student Energy Efficiency Kit Program was the student competitions: the Student Challenge, Video Contest, and Photo Contest. Student Challenge Each student that registered for the online activities were automatically entered into the Student Challenge. As students progressed through the online portion of the program, they earned points for each activity completed. In the web application, students followed their point progress and competed with classmates. Below is a sample of these activities: Action Points Earned Complete the online homework exercises 4,000 Install the products from the Energy Efficiency Kit 4,000 Complete the student survey 4,000 Submit a video contest entry 1,000 Complete the online pledge 500 The five students that accumlated the most points were awarded prizes. Photo Contest Students were given the opportunity to participate in a product photo contest. Students snapped a photo of a product installed from their kit for a chance to earn points and win prizes. Photos were uploaded through the Tinker web application. Thirteen entries were selected as winners and received prizes. Photo Contest Submission 15 Video Contest As part of the program, students were given the opportunity to participate in a video contest. Students could create a short two- to three-minute video about energy efficiency for a chance to win. Videos could be uploaded through the Tinker web application. Five entries were selected as winners and received prizes. Video Contest SubmissionVideo Contest Submission Video Contest Submission My favorite thing about the program was the kit boxes, the online homework quizzes for the students, and points awarded. C. Royse, Teacher Silver Trail Elementary School " " 16 Phase 2: Implementation STUDENT ENERGY EFFICIENCY KIT PROGRAMRECRUITMENT Beginning in August 2021, Tinker began the planning and recruitment of eligible teachers. Eligible teachers were from elementary schools in IPC’s service area based on a list of zip codes and communities served as provided by IPC. Tinker staff researched school and teacher information as well as determined eligibility in such a way that students who received a kit at that school in a prior grade did not have a second opportunity to receive a kit at the same school in a subsequent grade. As needed, IPC provided written clarification and verification of school and regional assignments. In September 2021, Tinker commenced active recruitment of eligible teachers. The program was offered to fourth-, fifth-, and sixth-grade teachers using a variety of communication tools to introduce the program and collect enrollment commitments. This included email templates, phone scripts, a promotional flyer, and video content. Tinker received commitments from 338 teachers. In April 2022, Tinker ceased active recruitment activities. Teacher Recruitment Video 17 During the 2021–2022 school year, fourth-, fifth, and sixth-grade teachers were introduced to the program and asked to participate. Commitments were received from 174 schools, representing 338 teachers and 12,257 students. The table represents participation in each region of IPC's service territory. Region State Teachers Students Total Kits Canyon ID 65 2797 2862 Capital ID 129 3922 4051 Eastern ID 44 1,542 1,586 Southern ID 54 2620 2674 Western ID 29 1,019 1,048 Total Idaho:321 11,900 12,221 Western OR 17 357 374 Total Oregon:17 357 374 *Detailed participation data can be found in Appendix C Phase 2: Implementation STUDENT ENERGY EFFICIENCY KIT PROGRAMPARTICIPATION 18 Through the program, 12,257 Energy Efficiency Kits were distributed to students. The kits were packed with high efficiency products that when installed help to curb household water and energy usage while reducing green house gas emissions. Students work with their parents to install the products and report their actions. Using the data collected, we calculated the projected resource savings. Projections are found below: Electricity Natural Gas Water Green House Gas Reduction Annual savings per student kit 188.02 kWh 3.44 Therms 1,408 Gals 0.15 Metric Tons Annual program savings student kits 2,304,617.38 kWh 42,176 Therms 17,259,185 Gals 1,857.40 Metric Tons Lifetime program savings student kits 18,054,873.77 kWh 421,757 Therms 172,591,850 Gals 15,027 Metric Tons *The algorithms and data used for these calculations can be found in Appendix A Phase 3: Reporting STUDENT ENERGY EFFICIENCY KIT PROGRAMPROJECTED SAVINGS Through the program, 338 Energy Efficiency Kits were distributed to teachers. Like students, teachers are asked to install the products. However, unlike students, some teachers received a kit in a prior school year or prior school years. To best estimate the projected savings from the teacher kits, Tinker has applied a 25% discount to the kit savings for each year a teacher previously received a kit. The table below depicts the percentage of savings applied to teacher kits based on previous program participation. Participating Years Number of Teachers Savings Percentage Applied 1 136 100% 2 75 75% 3 56 50% 4 71 25% 19 The factors that Tinker considered to determine the discount percentage were: 1. Energy efficiency products within the kits have changed occasionally year-over-year. Thus the entirety of the product savings for those products in which teachers have never received can be counted. 2. Products such as the LED lightbulbs and showerhead can be used in others areas of the home. Thus savings can be counted for those products. 3. In future program years, we intend to ask the teachers to report specific installation data. In the absence of data for this year a reasonable discount percentage was applied. Savings projections for the Teacher Kits are found below: Electricity Natural Gas Water Green House Gas Reduction Average annual savings per teacher kit 132.40 kWh 2.42 Therms 991.51 Gals 0.11 Metric Tons Average annual program savings teacher kits 44,749.85 kWh 818.95 Therms 335,129.8 Gals 36.05 Metric Tons Average lifetime program savings teacher kits 350,580.07 kWh 8,189.46 Therms 3,351,298.05 Gals 291.73 Metric Tons *The algorithms and data used for these calculations can be found in Appendix B Electricity Natural Gas Water Green House Gas Reduction Annual program savings:2,349,367 kWh 42,995 Therms 17,594,315 Gals 1,893.45 Metric Tons Lifetime program savings:18,405,454 kWh 429,947 Therms 175,943,147 Gals 15,318.73 Metric Tons Total projected program savings was derived by adding the projected savings from students and teachers. The total projected savings is found below: 20 To determine the effectiveness of the program, we collected pre- and post-program data to assess changes in students' knowledge, attitude, and behavior with respect to energy efficiency. The outcome is provided below. AFTER PARTICIPATING IN THE PROGRAM, STUDENTS INCREASED THEIR TEST SCORES BY 21% ON THE AVERAGE STUDENTS SCORED 87% ON THE POST-PROGRAM ASSESSMENT. ON THE AVERAGE STUDENTS SCORED 66% ON THE PRE-PROGRAM ASSESSMENT. PRE-ASSESSMENT POST- ASSESSMENT 21% National Average: 68%National Average: 85%National Average: 17% Phase 3: Reporting STUDENT ENERGY EFFICIENCY KIT PROGRAMPROGRAM ASSESSMENTS 21 At the conclusion of each lesson, students were ask to complete a lesson assessment. The assessment was designed to measure knowledge growth within the topic as well as the re-enforce the education. The results are used to determine the effectiveness of each lesson. The table below contains the average student score within each lesson assessment. Phase 3: Reporting STUDENT ENERGY EFFICIENCY KIT PROGRAMLESSON ASSESSMENTS Lesson Assessment Natural Resources 93% Electric Energy 91% Energy-Water Nexus 84% Peak and Off-peak Time 83% Electric Bill 89% Efficiency and Conservation 91% 22 Phase 3: Reporting STUDENT ENERGY EFFICIENCY KIT PROGRAMSTUDENT PLEDGES As part of the program students are asked to pledge four different ways they will save energy at home. Below is a sampling of the pledges collected: "I pledge to save energy and water by taking in shorter showers." Fatima M, Student "I pledge to ask my mom to make sure to clean my clothes with cold water instead of hot water." Aryan H, Student "I pledge that i will turn off the TV when not watching it." Isaiah C, Student "I pledge to save energy by turn off computers, monitors and games when not in use." Aaron A, Student "I pledge to turn of all the lights when I don't need to use them anymore." Ashley V, Student "I pledge to close my blinds during the summer, and keep them open during the winter." Emily U, Student "I pledge to tell my family to save electricity." Fernando M, Student "I pledge to turn off lights when they are not needed." Katie T, Student "Telling those around me how they can use energy more efficiently and conservatively." Camila F, Student "I pledge to save energy by using the LED lightbulbs from my energy efficiency kit." Jaden D, Student "I pledge to save energy by not leaving the refrigerator open for long." Kristen B, Student "I pledge to save energy by teaching other people to save water and use less energy." Samuel O, Student 23 At the conclusion of the program, students are asked to complete a survey detailing the actions they took and which products from the Energy Efficiency Kit they install. Surveys were received from 7,720 students. The reported data can be found below. 1 Did you enjoy the program? It was excellent 34.09% Pretty good 45.46% Neutral 13.38% Not so great 4.35% It was terrible 2.73% 2 Was the online content easy to use? Yes 70.58% No 29.42% 3 How many people (adults and children) live in your home? 5.02 People 4 Which type of fuel (energy) is used to heat water in your home? Electricity 60.27% Natural gas 29.13% Propane 10.60% I don't know 1400 5 How many showers are in your home? 2.19 Showers 6 Did you install the high efficiency showerhead from your kit? Yes 41.13% No, but I will install 29.54% No 29.32% 7 What was the water flow rate from your previous showerhead? 2.15 G.P.M. 8 What was the water flow rate when you installed the new showerhead from the kit? 1.41 G.P.M. Phase 3: Reporting STUDENT ENERGY EFFICIENCY KIT PROGRAMSTUDENT SURVEY 24 9 Did you use the shower timer from your kit? Yes 64.07% No, but I will 19.86% No 16.07% 10 Did you install the LED night light? Yes 78.13% No, but I will 20.68% No 1.19% 11 When installing the night light did you replace an existing night light? Yes 54.57% No 45.43% 13 How many LED lightbulbs did you install? 3 31.15%0.311501 2 65.60%0.344406 1 83.82%0.182388 0 16.17% 14 What was the wattage of the first lightbulb you replaced with the LED lightbulb? 39.1 Watts 15 What was the wattage of the second lightbulb you replaced with the LED lightbulb? 40.1 Watts 16 What was the wattage of the third lightbulb you replaced with the LED lightbulb? 41.3 Watts 17 Did you use the digital thermometer? Yes 49.50% No, but I will 24.84% No 25.66% 18 Did you raise or lower your water temperature? Our water was the perfect temperature. We did not adjust the water heater temperature 79.05% Our water was too hot! We lowered the water heater temperature 13.54% Our water was not hot enough. We raised our water heater temperature. 7.41% 25 19 Did you install the furnace filter whistle? Yes 33.21% No, but I will 26.63% No 40.16% 20 Did you use the sticker and magnet pack from your kit? Yes 63.20% No, but I will 18.28% No 18.53% 26 At the conclusion of the unit teachers were asked to complete a post-program evaluation. Outcomes are below: Phase 3: Reporting STUDENT ENERGY EFFICIENCY KIT PROGRAMTEACHER EVALUATION 1. Did you enjoy the program? It was excellent 43.59% It was pretty good 38.46% Neutral 10.26% Not so great 7.69% It was terrible 0.00% 2. How satisfied were your students with this program? They thought it was AWESOME! 25.64% They liked it 53.85% It was ok 16.67% They really didn't like it 3.85% 3. Did this program support the education standards in your grade level? Yes 96.15% No 0.00% Unsure 3.85% 4. Was the online content easy to use? Yes 60.26% No 39.74% 5. Was the program staff courteous? Yes 80.77% No 1.28% Did not interact with program staf 17.95% 5a. Did the program staff effectively answer all of your questions? Yes 98.41% No 1.59% 27 6. In your opinion, were parents effectively engaged? Yes 58.97% No 41.03% 7. Would you like to see this program continue? Yes 98.72% No 1.28% 8. If offered, would you participate again next school year? Yes 96.15% No 3.85% Yes 24.36% No 35.90% Maybe 39.74% 9. To aid in continuous improvement of the program, select teachers serve in an advisory capacity. Advising teachers are provided a stipend and meet twice per year. If asked, would you be willing to participate as an advisor? 28 Phase 3: Reporting STUDENT ENERGY EFFICIENCY KIT PROGRAMTEACHER MINI-GRANTS As part of the program, teachers had the opportunity to a mini-grant for classroom supplies. Teachers that earned the mini-grant completed the following activities: 1. Completed the classroom portion of the lessons. 2. Assigned the online homework exercises. 3. Distributed the Energy Efficiency Kits to students. 4. Completed the post-program evaluation in the online teacher portal. 5. Returned the postage-paid return envelope with the following: • Student thank-you letters • Teacher thank-you letter on school letterhead The mini-grant award was based on verified completion of each task above, as well as how many students completed the student survey. The amount of the mini-grant varied depending on the number of student surveys submitted. The awards are listed in the table below: Student Survey Return Rate Award Amount Number Awarded 25 to 49%$25.00 32 50 to 64%$50.00 25 65 to 79%$75.00 51 80 to 100%$100.00 103 *Detailed award information can be found in the Student Energy Efficiency Kit Program dashboard. 29 In addition to successful implementation of the Student Energy Efficiency Kit Program, Tinker LLC evaluates program outcomes in an effort to continually improve the program. Areas to be enhanced are identified below: Content. As identified in this report, students successfully completed the lessons which resulted in a net knowledge gain. During school year 2022-2023, Tinker LLC plans to enhance the content through:1. The redesign of some lessons and minor updates to others. This includes designing unique Electric Bill lessons for fourth-, fifth-, and sixth-grade students.2. Offer teachers the option to receive paper copies of the Student Survey during the enrollment process.3. Review lesson length for lower grade levels. Teacher Program Administration. Based on feedback from particiating teachers, Tinker LLC plans to enhance the following teacher administration tools: 1. Integrate the seemless google login feature for teachers and students. This will allow teachers and students to use a single school login to access the google suite of digital tools and the Web App. 2. For teachers without google classroom, Tinker will normalize the student username across all classes. 3. Upgrade the student tracking and reporting module in the teacher portal. These enhancements will improve the program while continuing to meet the changing needs of educators and students. Ultimately these will result in increased knowledge leading to the adoption of sustainable habits as well as responsible energy use amongst program participants. Phase 3: Reporting STUDENT ENERGY EFFICIENCY KIT PROGRAMCONTINUOUS IMPROVEMENT 30 SHOWERHEAD RETROFIT Student Energy Efficiency Kit Projected Savings APPENDIX A Reported Inputs (Exact Numbers Reported) Average household size: 5.02 people Showers per home:2.19 showers Previous showerhead flow rate:2.15 gallons Retrofit showerhead flow rate:1.41 gallons Percent of homes with electric water heat:60.27% Percent of homes with natural gas water heat:29.13% Retrofit showerhead installation rate:41.13% Participants using kits:12,257 Kits Assumed Inputs Showers per day per person:0.67 showers1 Average length of use:8.2 minutes1 Percent of showerhead water that is heated:73%hot water1 Temperature of incoming cold water:55°1 Temperature of outgoing hot water:120°1 Product life:10 years2 Outcomes Projected annual water savings for all households:17,259,184.93 Gallons1 Projected annual electric savings for all households:1,366,788.76 kWh4 Projected annual natural gas savings for all households:33,030.73 Therms5 Projected annual GHG reduction for all households:1,144.00 Metric Tons3 Projected lifetime water savings for all households:172,591,849.33 Gallons1 Projected lifetime electric savings for all households:13,667,887.57 kWh1 Projected lifetime natural gas savings for all households:330,307.28 Therms1 Projected lifetime GHG reduction for all households:11,434.00 Metric Tons3 31 SHOWERHEAD RETROFIT Student Energy Efficiency Kit Projected Savings APPENDIX A Step 1 *Equation is divided by full bathrooms per home because we only provide one showerhead Step 2 gallons saved per day x 365 days = gallons saved per year Step 3 2 Manufacturer 5 WaterSense® Specification for Showerheads Supporting Statement. EPA, 2010, Appendix A: Calculations and Key Assumptions. Note: o Therms Required to Raise 1 Gallon of Water 65º F [(1.0 Btu/lbs x º F) (1 Therm/99,976 Btus) / (1 gal/8.34 lbs) x 65º F] / 0.60 = 0.009 Therms/gal 1 WaterSense® Specification for Showerheads Supporting Statement. EPA, 2010, Appendix A: Calculations and Key Assumptions. Note: gallons saved per year x retrofit showerhead installation rate x participants = gallons saved per year program- wide [(Previous showerhead flow rate - Retrofit showerhead flow rate) x Average length of use: 8.2min x Showers per day per person: 0.67 x Average household size] ÷ Full bathrooms per home = gallons saved per day 3 “Greenhouse Gas Equivalencies Calculator.” EPA, Environmental Protection Agency, June. 2022, https://www.epa.gov/energy/greenhouse-gas-equivalencies-calculator. 4 WaterSense® Specification for Showerheads Supporting Statement. EPA, 2010, Appendix A: Calculations and Key Assumptions. Note: o KWh Required to Raise 1 Gallon of Water 65º F [(1.0 Btu/lbs x º F) (1kWh/3,412 Btus) / (1 gal/8.34 lbs) x 65º F] / 0.90 = 0.18 kWh/gal 32 LED LIGHTBULB #1 RETROFIT Student Energy Efficiency Kit Projected Savings APPENDIX A Reported Inputs Retrofit LED light bulb installation rate:83.82% Participants using kits:12,257 Kits Average watts used by the replaced bulb:39.13 watts Assumed Inputs Remaining useful life of replaced bulb:1,000 hours1 Watts used by the LED light bulb:8 watts2 Hours of operation per day:2.1 hours per day3 Outcomes Projected annual electric savings for all households:245,155.71 kWh4 Projected annual GHG reduction for all households:174 Metric Tons5 Projected lifetime electric savings for all households:319,837.84 kWh6 Projected lifetime GHG reduction for all households:227 Metric Tons5 2 Manufacturer 3 "Regional Technical Forum." ResidentialLighting-v10-0. Lamps_StorageRemoval. General Purpose and Three Wa . 250 to 1049 lumens. An - Res. Onl4{[(Average wattage of light bulb replaced - Wattage of LED light bulb) x Hours of operation per day x 365 Days] ÷ 1,000} x Participants using kits x Retrofit LED light bulb installation rate 5 “Greenhouse Gas Equivalencies Calculator.” EPA, Environmental Protection Agency, June. 2022, htt s:www.e a.ov ener reenhouse-as-e uivalencies-calculator. 1 Remaining Useful Life (RUL) is 1/3 of useful life. Average Halogen useful life is 3,000 hours. Thus RUL is 1000 hours. (https://www.bulbs.com/learning/arl.aspx) 6 {[(Average wattage of light bulb replaced - Wattage of LED light bulb) x Remaining useful life of replaced bulb] 33 LED LIGHTBULB #2 RETROFIT Student Energy Efficiency Kit Projected Savings APPENDIX A Reported Inputs Retrofit LED light bulb installation rate:65.60% Participants using kits:12,257 Kits Average watts used by the replaced bulb:40.09 watts Assumed Inputs Remaining useful life of replaced bulb:1,000 hours1 Watts used by the LED light bulb:8 watts2 Hours of operation per day:2.1 hours per day3 Outcomes Projected annual electric savings for all households:197,770.63 kWh4 Projected annual GHG reduction for all households:140 Metric Tons5 Projected lifetime electric savings for all households:258,017.79 kWh6 Projected lifetime GHG reduction for all households:183 Metric Tons5 2 Manufacturer 1 Remaining Useful Life (RUL) is 1/3 of useful life. Average Halogen useful life is 3,000 hours. Thus RUL is 1000 hours. (https://www.bulbs.com/learning/arl.aspx) 3 "Regional Technical Forum." ResidentialLighting-v10-0. Lamps_StorageRemoval. General Purpose and Three Wa . 250 to 1049 lumens. An - Res. Onl4{[(Average wattage of light bulb replaced - Wattage of LED light bulb) x Hours of operation per day x 365 Days] ÷ 1,000} x Participants using kits x Retrofit LED light bulb installation rate 5 “Greenhouse Gas Equivalencies Calculator.” EPA, Environmental Protection Agency, June. 2022, htt s:www.e a.ov ener reenhouse-as-e uivalencies-calculator.6 {[(Average wattage of light bulb replaced - Wattage of LED light bulb) x Remaining useful life of replaced bulb] 34 LED LIGHTBULB #3 RETROFIT Student Energy Efficiency Kit Projected Savings APPENDIX A Reported Inputs Retrofit LED light bulb installation rate:31.15% Participants using kits:12,257 Kits Average watts used by the replaced bulb:41.25 watts Assumed Inputs Remaining useful life of replaced bulb:1,000 hours1 Watts used by the LED light bulb:8 watts2 Hours of operation per day:2.1 hours per day3 Outcomes Projected annual electric savings for all households:97,323.34 kWh4 Projected annual GHG reduction for all households:69 Metric Tons5 Projected lifetime electric savings for all households:126,971.09 kWh6 Projected lifetime GHG reduction for all households:90 Metric Tons5 2 Manufacturer 1 Remaining Useful Life (RUL) is 1/3 of useful life. Average Halogen useful life is 3,000 hours. Thus RUL is 1000 hours. (https://www.bulbs.com/learning/arl.aspx) 3 "Regional Technical Forum." ResidentialLighting-v10-0. Lamps_StorageRemoval. General Purpose and Three Wa . 250 to 1049 lumens. An - Res. Onl4{[(Average wattage of light bulb replaced - Wattage of LED light bulb) x Hours of operation per day x 365 Days] ÷ 1,000} x Participants using kits x Retrofit LED light bulb installation rate 5 “Greenhouse Gas Equivalencies Calculator.” EPA, Environmental Protection Agency, June. 2022, htt s:www.e a.ov ener reenhouse-as-e uivalencies-calculator.6 {[(Average wattage of light bulb replaced - Wattage of LED light bulb) x Remaining useful life of replaced bulb] 35 LED NIGHT LIGHT RETROFIT Student Energy Efficiency Kit Projected Savings APPENDIX A Reported Inputs Retrofit LED night light installation rate:78.13% Participants using kits:12,257 Kits Assumed Inputs Product life:8 years1 Watts used by the LED night light:0.5 watts1 Average length of use:4380 hours per year Average watts used by the replaced bulb:4 watts1 Outcomes Projected annual electric savings for all households:146,814.98 kWh3 Projected annual GHG reduction for all households:104 Metric Tons4 Projected lifetime electric savings for all households:1,174,519.85 kWh3 Projected lifetime GHG reduction for all households:832 Metric Tons4 1 Manufacturer 3 {[(Average wattage of light bulb replaced - Wattage of LED night light) x Hours of operation per day x 365 Days] ÷ 1,000} x Participants using kits x Retrofit LED night light installation rate 4 “Greenhouse Gas Equivalencies Calculator.” EPA, Environmental Protection Agency, June. 2022, htt s:www.e a.ov ener reenhouse-as-e uivalencies-calculator. 36 FILTER WHISTLE RETROFIT Student Energy Efficiency Kit Projected Savings APPENDIX A Reported Inputs Filter Whistle installation rate:33.21% Participants using kits:12,257 Kits Assumed Inputs Annual energy (electricity) use by a central air conditioner:4467 kWh1 Percent of customers with central air conditioning or heat pump:78.8%2 Annual energy (natural gas) use by a central space heating or furnace 421 therms1 Percent of customers using gas heat:58.0%2 Projected increase in efficiency (electricity):1.75%3 Projected increase in efficiency (natural gas):0.92%3 Product life:10 years4 Outcomes Projected annual electric savings for all households:250,763.96 kWh Projected annual natural gas savings for all households:9,144.98 Therms Projected annual GHG reduction for all households:226.4 Metric Tons5 Projected lifetime electric savings for all households:2,507,639.63 kWh Projected lifetime natural gas savings for all households:91,449.81 Therms Projected lifetime GHG reduction for all households:2,261 Metric Tons5 2 Idaho Power's 2022 Residential End-Use Study 3 Reichmuth P.E., Howard. (1999). Engineering Review and Savings Estimates for the Filter Restriction Alarm. 4 Provided by manufacturer. 1 U.S. Department of Energy, Energy Information Administration 2005 Residential Energy Consumption Web site: http://www.eia.gov/ 5 “Greenhouse Gas Equivalencies Calculator.” EPA, Environmental Protection Agency, June. 2022, https://www.epa.gov/energy/greenhouse-gas-equivalencies-calculator. 37 TEACHER KIT SAVINGS Teacher Energy Efficiency Kit Projected Savings APPENDIX B No. of Years Participating Student Kit Savings Savings Percentage Applied Number of Teachers Total Annual Savings 1 188.02 kWh 100%136 25,571.34 kWh 2 188.02 kWh 75%75 10,576.38 kWh 3 188.02 kWh 50%56 5,264.69 kWh 4 188.02 kWh 25%71 3,337.44 kWh Student Kit Savings x Savings Percentage Applied x Number of Teachers = Total Annual Savings Total:44,749.85 kWh No. of Years Participating Student Kit Savings Savings Percentage Applied Number of Teachers Total Annual Savings 1 3.44 Therms 100%136 467.97 Therms 2 3.44 Therms 75%75 193.55 Therms 3 3.44 Therms 50%56 96.35 Therms 4 3.44 Therms 25%71 61.08 Therms Student Kit Savings x Savings Percentage Applied x Number of Teachers = Total Annual Savings Total:818.95 Therms No. of Years Participating Student Kit Savings Savings Percentage Applied Number of Teachers Total Annual Savings 1 1,408.11 Gals 100%136 191,502.75 Gals 2 1,408.11 Gals 75%75 79,206.10 Gals 3 1,408.11 Gals 50%56 39,427.04 Gals 4 1,408.11 Gals 25%71 24,993.92 Gals Student Kit Savings x Savings Percentage Applied x Number of Teachers = Total Annual Savings Total: 335,129.80 Gals Total Annual Savings No. of Teacher Kits Distributed Average Annual Savings per Kit 44,749.85 kWh 338 kits 132.40 kWh 818.95 Therms 338 kits 2.42 therms 335,129.80 Gals 338 kits 991.51 Gals Total Annual Savings ÷ No. of Teacher Kits Distributed = Average Annual Savings per Kit 38 PARTICIPATION TABLE Capital Region APPENDIX C Region State School Teachers Students Total Capital ID Adams Elementary 1 50 51 Capital ID Amity Elementary School 3 74 77 Capital ID Andrus Elementary 1 27 28 Capital ID Basin Elementary School 1 30 31 Capital ID Chaparral Elementary 1 27 28 Capital ID Christine Donnell School of the Arts 1 76 77 Capital ID Desert Sage Elementary 1 31 32 Capital ID Discovery Elementary 3 70 73 Capital ID Eagle Hills Elementary 1 25 26 Capital ID Falcon Ridge Charter 1 34 35 Capital ID Future Public School 2 105 107 Capital ID Galileo STEM Academy 3 93 96 Capital ID Garfield Elementary 1 26 27 Capital ID Glenns Ferry Elementary School 2 37 39 Capital ID Grace Jordan Elementary School 3 68 71 Capital ID Hacker Middle School 10 266 276 Capital ID Heritage Middle School 1 180 181 Capital ID Hidden Springs Elementary 2 47 49 Capital ID Highlands Elementary School 2 46 48 Capital ID Hillcrest Elementary School 1 19 20 Capital ID Hillsdale Elementary School 4 108 112 Capital ID Home School 1 2 3 Capital ID Horizon Elementary 1 30 31 39 PARTICIPATION TABLE Capital Region APPENDIX C Region State School Teachers Students Total Capital ID Hunter Elementary 4 100 104 Capital ID Joplin Elementary 2 56 58 Capital ID Koelsch Elementary 1 25 26 Capital ID Lake Hazel Elementary 3 77 80 Capital ID Liberty Elementary 2 55 57 Capital ID Longfellow Elementary School 1 28 29 Capital ID Mary McPherson Elementary 1 26 27 Capital ID Meridian Middle School 1 155 156 Capital ID Monroe Elementary 1 21 22 Capital ID Morley Nelson Elementary School 2 62 64 Capital ID North Elementary School 3 79 82 Capital ID Owyhee Elementary 1 18 19 Capital ID Peregrine Elementary 2 101 103 Capital ID Ponderosa Elementary 3 93 96 Capital ID Raising Arrows Academy 1 4 5 Capital ID Reed Elementary School 7 159 166 Capital ID Rimrock Jr./Sr. High 1 20 21 Capital ID Riverside Elementary School 1 26 27 Capital ID Riverstone International School 1 33 34 Capital ID Roosevelt Elementary 1 50 51 Capital ID Rose Hill Montessori 1 11 12 Capital ID Ross Elementary 2 59 61 Capital ID Sacred Heart Catholic School 1 17 18 40 Region State School Teachers Students Total Capital ID Sawtooth Elementary School 1 145 146 Capital ID Sawtooth Middle School 1 115 116 Capital ID Seven Oaks Elementary 3 105 108 Capital ID Shadow Hills Elementary School 3 78 81 Capital ID Silver Sage Elementary School 1 50 51 Capital ID Silver Trail Elementary 4 86 90 Capital ID Spalding Elementary 1 30 31 Capital ID Spalding STEM Academy 2 59 61 Capital ID Star Elementary 4 117 121 Capital ID Summerwind STEM Academy 3 69 72 Capital ID Valley View Elementary School 4 45 49 Capital ID Washington Elementary School 2 21 23 Capital ID West Elementary School 3 79 82 Capital ID White Pine Elementary School 3 72 75 Capital ID Whitney Elementary School 3 75 78 Capital ID Whittier Elementary School 1 30 31 Total:129 3922 4051 PARTICIPATION TABLE Capital Region APPENDIX C 42 Region State School Teachers Students Total Canyon ID Birch Elementary 5 116 121 Canyon ID Centennial Elementary 3 79 82 Canyon ID Central Canyon Elementary School 3 83 86 Canyon ID Central Elementary 2 45 47 Canyon ID Desert Springs Elementary 4 106 110 Canyon ID East Canyon Elementary School 1 112 113 Canyon ID Fremont Middle School 1 120 121 Canyon ID Gem Prep Nampa 2 72 74 Canyon ID Heights Elementary 1 105 106 Canyon ID Heritage Community Charter 1 65 66 Canyon ID Kuna Middle School 1 152 153 Canyon ID Lewis and Clark Elementary School 3 70 73 Canyon ID Melba Elementary 3 75 78 Canyon ID Middleton Middle School 2 290 292 Canyon ID Mill Creek Elementary 5 135 140 Canyon ID Mosaics Public School 1 47 48 Canyon ID Owyhee Elementary 2 55 57 Canyon ID Park Ridge Elementary 2 50 52 Canyon ID Purple Sage Elementary 3 71 74 Canyon ID Ronald Reagan Elementary 3 82 85 Canyon ID Sacajawea Elementary School 3 84 87 Canyon ID South Middle School 2 375 377 Canyon ID St Pauls Catholic School 1 17 18 PARTICIPATION TABLE Canyon Region APPENDIX C 43 PARTICIPATION TABLE Canyon Region Region State School Teachers Students Total Canyon ID Thomas Jefferson Charter School 1 33 34 Canyon ID Vallivue Middle School 1 145 146 Canyon ID Van Buren Elementary 1 24 25 Canyon ID Washington Elementary School 1 30 31 Canyon ID West Canyon Elementary School 3 74 77 Canyon ID Wilder Elementary 1 21 22 Canyon ID Wilson Elementary School 3 64 67 Total:65 2797 2862 APPENDIX C 44 PARTICIPATION TABLE Eastern Region Region State School Teachers Students Total Eastern ID Aberdeen Middle School 1 55 56 Eastern ID Alameda Middle School 1 91 92 Eastern ID American Falls Academy 1 12 13 Eastern ID Chief Tahgee Elementary Academy 1 15 16 Eastern ID Chubbuck Elementary School 1 82 83 Eastern ID CONNOR ACADEMY 2 64 66 Eastern ID Donald D. Stalker Elementary 2 36 38 Eastern ID Fort Hall Elementary 1 24 25 Eastern ID Franklin Middle School 2 174 176 Eastern ID Gem Prep Pocatello 1 50 51 Eastern ID Greenacres Elementary School 2 65 67 Eastern ID Groveland Elementary 2 43 45 Eastern ID Hawthorne Middle School 1 44 45 Eastern ID Holy Spirit Catholic School 1 15 16 Eastern ID I.T Stoddard 1 30 31 Eastern ID Idaho Science and Technology 1 22 23 Eastern ID Inkom Elementary School 2 27 29 Eastern ID Leadore School 1 20 21 Eastern ID Lewis and Clark Elementary 3 80 83 Eastern ID Pocatello Community Charter 1 74 75 Eastern ID Ridge Crest Elementary 2 46 48 Eastern ID Rockland School 1 20 21 Eastern ID Rulon M Ellis Elementary School 3 72 75 APPENDIX C 45 PARTICIPATION TABLE Eastern Region APPENDIX C Region State School Teachers Students Total Eastern ID Salmon Pioneer Elementary School 1 42 43 Eastern ID Syringa Elementary School 3 83 86 Eastern ID Tendoy Elementary School 1 30 31 Eastern ID Tyhee Elementary School 4 111 115 Eastern ID William Thomas Middle School 1 115 116 Total:44 1,542 1,586 46 PARTICIPATION TABLE Southern Region Region State School Teachers Students Total Southern ID Acorn Learning Center 1 9 10 Southern ID BUHL MIDDLE SCHOOL 1 100 101 Southern ID Camas County Schools 1 25 26 Southern ID Carey School 1 19 20 Southern ID Dietrich Schools 1 13 14 Southern ID Downey Elementary 1 13 14 Southern ID Ernest Hemingway Steam School 1 25 26 Southern ID Filer Intermediate School 3 70 73 Southern ID Hagerman Elementary School 1 31 32 Southern ID Hailey Elementary School 3 58 61 Southern ID Harrison Elementary School 2 52 54 Southern ID Hollister Elementary School 2 20 22 Southern ID I.B. Perrine Elementary 3 71 74 Southern ID Immanuel Lutheran School 1 16 17 Southern ID Jerome Middle School 2 330 332 Southern ID Oakley Elementary 1 34 35 Southern ID Popplewell Elementary School 2 145 147 Southern ID Robert Stuart Middle School 3 359 362 Southern ID Rock Creek Elementary School 2 139 141 Southern ID Sawtooth Elementary School 1 29 30 Southern ID Shoshone Elementary 2 40 42 Southern ID South Hills Middle School 1 240 241 Southern ID St Edwards Catholic School 1 13 14 APPENDIX C 47 PARTICIPATION TABLE Southern Region APPENDIX C Region State School Teachers Students Total Southern ID Stricker Elementary 1 21 22 Southern ID Summit Elementary 11 266 277 Southern ID Vera C. O'Leary Middle School 1 105 106 Southern ID West Minico Middle School 2 202 204 Southern ID Wood River Middle School 2 175 177 Total:54 2620 2674 48 PARTICIPATION TABLE Western Region Region State School Teachers Students Total Western ID Cambridge Elementary 1 12 13 Western ID Cascade Elementary School 1 18 19 Western ID Fruitland Elementary School 5 138 143 Western ID Fruitland Middle School 1 20 21 Western ID Horseshoe Bend Elementary School 1 11 12 Western ID Kenneth J. Carberry Elementary 4 117 121 Western ID McCain Middle School 1 125 126 Western ID New Plymouth Elementary 3 74 77 Western ID Ola Elementary School 1 10 11 Western ID Park School 4 105 109 Western ID Parma Middle School 1 80 81 Western ID Payette Lakes Middle School 1 105 106 Western ID Weiser Middle School 1 101 102 Western ID Westside Elementary School 4 103 107 Total:29 1,019 1,048 APPENDIX C 49 PARTICIPATION TABLE Western Region APPENDIX C Region State School Teachers Students Total Western OR Adrian Elementary 1 24 25 Western OR Annex Charter School 1 16 17 Western OR Harper Charter School 1 19 20 Western OR Henry L. Slater Elementary School 3 62 65 Western OR Huntington School 1 11 12 Western OR May Roberts Elementary School 2 49 51 Western OR Nyssa Elementary School 2 43 45 Western OR Pioneer Elementary School 1 17 18 Western OR St Peter Catholic School 1 40 41 Western OR Vale Elementary 3 55 58 Western OR Willowcreek Elementary School 1 21 22 Total:17 357 374 50 PARTICIPANT LETTERS Teacher Letters APPENDIX D 51 PARTICIPANT LETTERS Teacher Letters APPENDIX C 52 PARTICIPANT LETTERS Teacher Letters APPENDIX D 53 PARTICIPANT LETTERS Teacher Letters APPENDIX C www.adaptiveconsumerengagement.com Page 1 of 45 Table of Contents 1. Executive Summary 5 1. Project Overview 5 2. 2022: Summary of Results and Findings 7 3. 3. Program Attrition 10 1. Program Overview 14 1.1 Team Structure 14 1.2 Objectives 14 1.2.1 2022 Objectives 14 1.2.2 Additional Objectives 14 1.3 Eligibility Screening 14 1.3.1 Eligibility Screening 15 1.4 Evaluation, Measurement & Veriﬁcation Process 16 1.5 Customer Data Acquisition/Integration 17 1.6 Benchmarking Flags 20 1.7 Improving Tip Selection 21 4. 1.6.1 Enhanced Water Heater Tips 21 5. 1.6.2 Overview of segmentation used for 2022 21 2. 2022 Program Results Detail 22 2.1 Objectives: Findings 22 2.1.1 Energy Savings 22 2.1.2 Monthly Savings by Treatment Group 24 2.1.3 2022 Combined Savings for Expansion participants (T6) Vs. Pilot Participants (T1234) 24 2.2 Email Reports 25 2.2.1 Delivery, Open, and Bounce Rates 25 2.3 Customer Feedback 25 2.3.1 Customer Service Line Calls and Opt-Out Rates 25 2.4 Additional Metrics 29 2.4.1 Microsite Engagement 29 2.4.2 My Account Web Activity 30 2.4.3 Attrition Rate Detail 31 3. Process Improvements, Lessons Learned, and Future Considerations 33 3.1 Process Improvements 33 3.2 Lessons Learned 34 3.3 Future Considerations 35 www.adaptiveconsumerengagement.com Page 2 of 45 4. Appendices 37 4.1 Appendix A: Sample Home Energy Reports 37 4.2 Appendix B: Quarterly Program Monitoring Reports 45 www.adaptiveconsumerengagement.com Page 3 of 45 Revision History Date Version Description Author/Editor 2-27-2023 1.0 Initial Draft Thea Winch 3-3-2023 1.1 Additional edits/comments Thea Winch 3-9-2023 1.2 Final Version Thea Winch 1.3 Additional edits/comments Document Approval The purpose of this section is to acknowledge approval of the information presented within. Please use the track-changes features to indicate any changes necessary before approval of the plan can be made. When ready to approve, please indicate the version number being approved, and complete the ﬁelds below. This Idaho Power Company Home Energy Report 2022 Final Program Summary, version 1.3 approved by: Client Name: Name, Title: Signature Date: Client Name: Name, Title: Signature: Date: Utility Consumer Analytics, Inc. Name, Title Signature: Date: www.adaptiveconsumerengagement.com Page 4 of 45 1. Executive Summary 1. P ROJECT O VERVIEW Energy savings due to behavioral changes in the home have traditionally been diﬃcult to measure. Home Energy Report (HER) programs rely on a randomized controlled trial (RCT) structure to calculate energy savings and ensure program results are both unbiased and precise. The RCT approach is the most commonly used approach for implementing HER programs in North America. With this approach, we identify an eligible pool of customers based on the desired program outcome, and then randomly allocate a subset of customers into the treatment group who will receive the behavioral intervention (Home Energy Reports), and the remainder into the control group who will not receive the intervention. We estimate average customer-level savings from the behavioral program by measuring the diﬀerence in the average energy usage among the treatment group relative to the control group. Program energy savings are the average customer-level savings multiplied by the number of active treatment group participants. Filters applied to identify customers who may participate in the program are based on recommendations from the vendor, as well as Idaho Power’s experience and pilot learnings. Due to Oregon’s small customer base, Idaho Power’s (IPC) HER program is currently available only in Idaho. Program Group refers to customers that are in the treatment group and are actively being treated with reports. These customers by default are also part of the evaluation group. Evaluation Group refers to customers that are in the treatment or control group and are factored into the savings evaluations. Treatment customers in this group may or may not be actively receiving reports. Customers in the treatment group but not in program group remain in the treatment group to maintain the RCT but are not actively treated for a variety of reasons discussed later in the report. Customers in the evaluation group are broken into treatment and corresponding control groups. T1 through T5 were onboarded in 2017 and 2018 as part of the pilot. T6 became active in 2020. ● T1: customers with high winter use (electric heating) added in Year One ● T2: customers with high winter use (electric heating) added in Year Two ● T3: customers with high year-round energy use added in Year One ● T4: customers with medium year-round energy use added in Year One ● T5: customers with low year-round energy use added in Year One. o Note: these customers were removed from the program in 2020 and received their last report in February of 2020 ● T6: expansion customers based on eligibility criteria determined after the pilot The table below shows the number of customers in the treatment, control, and program groups at the beginning and end of 2022. Customers are removed from both groups when they move out . Table 1: 2022 RCT and Program Group Participant Counts www.adaptiveconsumerengagement.com Page 5 of 45 Program Control Treatment Jan 1 Dec 31 Net Diﬀ Jan 1 Dec 31 Net Diﬀ Jan 1 Dec 31 Net Diﬀ T1 4,664 4,398 266 1,257 1,186 71 5,094 4,730 364 T2 3,865 3,670 195 710 664 46 4,429 4,154 275 T3 4,861 4,610 251 3,073 2,881 192 5,174 4,837 337 T4 2,274 2,164 110 2,277 2,135 142 2,426 2,272 154 T5* 48,081 45,295 2,786 4,149 3,915 234 T6 89,162 83,674 5,488 12,493 11,477 1,016 91,817 84,772 7,045 Combined Total 104,826 98,516 6,310 67,891 63,638 4,253 113,089 104,680 8,409 *T5 stopped receiving reports in 2020 so they are no longer in the Program Group. Residual savings from T5 are still calculated for the PSR, so Treatment and Control counts are still tracked. The Home Energy Reports included the following elements: ● Customer information: customer name, address, and account number ● Household energy-usage disaggregation: home usage separated into four loads (heating, air conditioning, lights & appliances, and always-on) ● Targeted message(s) : customized messaging to drive customers to relevant programs and the My Account portal ● Social benchmarks : customer’s home energy use compared to similar homes and eﬃcient homes, designed to motivate savings ● Personalized savings recommendations: Tips for saving energy based on home proﬁle attributes, customer segmentation, and season Table 2 – 2022 Report Delivery Schedule by Cohort www.adaptiveconsumerengagement.com Page 6 of 45 2. 2022: S UMMARY OF R ESULTS AND F INDINGS Main takeaways from 2022 are as follows. Savings In 2022, total savings calculated are 20,474,995 kWh. Collectively, the savings for all waves combined are statistically signiﬁcant. Although T-5 did not receive reports after February of 2020, when compared with their control group, they showed persistent savings. Including the savings from T5, the overall annual 2022 savings from this program are 20,734,611 kWh. Using a weighted average calculation without T5 residual savings factored in, the treatment groups saved 1.31% or 200.74 kWh per customer. With residual savings from T5 included, the weighted average savings for all treatment groups was 195.77 per customer or 1.30%. Table 3: 2022 Program Savings by T-Groups Cohort Average Energy Savings in kWh per Customer Cumulative Savings (all months, all households, kWh) Percent Savings Statistical Signiﬁcance T1 162.77 781,761 0.71% N T2 56.71 238,339 0.26% N T3 227.70 1,113,894 1.49% Y T4 267.44 612,969 2.47% Y T5 66.31 259,616 0.89% N T6 206.61 17,728,033 1.35% Y Combined Groups 195.77 20,734,611 1.3% Y www.adaptiveconsumerengagement.com Page 7 of 45 Table 4: 2022 Home Energy Reports Delivered in 2022 Report Cycle Recipients # of Email only Recipients # of Paper Only Recipients # of Both Email & Paper Recipients # of Unique Customers Receiving HERs Total Reports Delivered February T1, T2, T3, T4, T6 150 104,676 N/A 104,826 104,826 May T1, T2, T3, T4, T6 150 102,828 N/A 102,978 102,978 August T1, T2, T3, T4, T6 153 47,766 52,801 100,720 153,521 November T1, T2, T3, T4, T6 125 52,747 45,769 98,641 144,410 2022 Report Totals 578 308,017 98,570 N/A 505,735 2022 Participants 104,826 Notes on Table 4: ● In August of 2022 we expanded email HERs (eHERs) to all customers with an email address. ● Prior to the eHER expansion, only customers that opted into email and out of paper were eligible to receive email reports. This is why there were no customers receiving email and paper reports prior to August 2021. ● For the purposes of calculating cost eﬀectiveness, the participant count will include customers who receive at least one report during the calendar year. This is typically based on the number of reports sent in the ﬁrst report cycle of the year. For 2022, the participant count will be 104,826. www.adaptiveconsumerengagement.com Page 8 of 45 Table 5: Year-Over-Year Home Energy Reports Delivered Program Year Recipients Email Only Reports Sent Paper Only Reports Sent Both Paper and Email Reports Sent # of Program Participants Year 1 of Pilot (2017-2018) T1, T3, T4, T5 N/A 149,546 N/A 23,914 Year 2 of Pilot (2018-2019) T1, T2, T3, T4, T5 N/A 116,087 N/A 24,976 2020 T1, T2, T3, T4, T5, T6 257 488,545 N/A 127,313 2021 T1, T2, T3, T4, T6 507 445,334 N/A 115,153 2022 T1, T2, T3, T4, T6 578 406,587 98,570 104,826 Total Reports Delivered N/A 1,342 1,718,002 98,570 N/A Notes on Table 5: ● T2 was launched in 2018 ● Email reports launched at the beginning of 2019 ● T5 was discontinued in 2020. The last report they received was in February 2020 ● T6 launched in May of 2020 and customers received ﬁrst report in June of 2020 ● IPC pulled Total Reports Delivered data for Year 1 of Pilot (2017-2018) and Year 2 (2018-2019) ● Uplight pulled Total Reports Delivered Data for 2020, 2021, and 2022 Email HER-Speciﬁc Statistics In 2022, 99,148 total emails were sent. Of those, 97,971 emails were successfully delivered, and a total of 49,617 were opened. This is a 51% open rate which is stronger than average. The total clickthrough rate (that is, the rate of clicks on links contained within the emails) was 2.47%. Customer Calls ﬁelded by IPC’s Customer Solutions Advisors The total number of customer calls has steadily decreased from the peak in 2020 when T6 was launched. In 2022 there was a 38% decrease in the total number of calls compared to 2021. The reduction in 2022 is especially notable since the number of eHERs being sent increased signiﬁcantly www.adaptiveconsumerengagement.com Page 9 of 45 when eHERs were expanded to all eligible customers in the Program Group. The expansion increased the number of eHERs sent from 507 in 2021 to 99,148 in 2022. Table 6: Year-Over-Year Customer Calls Year 1 of Pilot (2017-2018) Year 2 of Pilot (2018-2019) 2020 2021 2022 Total Calls* 411 246 1,087 660 409 Total Reports Delivered 149,546 116,087 448,802 445,841 505,735 % to # of reports delivered 0.27% 0.21% 0.24% 0.15% 0.08% Notes on Table 6: ● IPC pulled Total Reports Delivered data for Year 1 of Pilot (2017-2018) and Year 2 (2018-2019) ● Uplight pulled Total Reports Delivered Data for 2020, 2021, and 2022 3. 3. P ROGRAM A TTRITION Attrition Rates Attrition rate measures the number of people removed from the HER program, either due to not meeting program requirements (as speciﬁed below), or because participants chose to opt out. The permanent attrition rate in 2022 was 6.92% with 9,334 customers either opting out or being permanently removed for one of the following reasons: move-outs, incompatible location type*, or incompatible property type**. This is down from 2021 when permanent attrition rate was 7.82% with 10,546 customers either opting out or being permanently removed, and from 2020 when permanent attrition rate was 9.4% with 11,850 customers either opting out or being permanently removed. Permanent removals aﬀect the Evaluation Group (both treatment and control). Customers who opt-out of the program no longer receive reports (no longer part of the program group), but their data remain as part of the evaluation group to maintain the balance of the RCT. *Customers with zip codes outside of the geographic parameters for similar home comparrisons, or those catgorized as insuﬃcient location benchmarking, are veriﬁed as incompatible location. **Pilot customers whose home types are single family home or manufactured home are eligible to receive reports. For T6, only customers whose home type is single family home are eligible to receive reports. All other home types are considered incompatible property type. www.adaptiveconsumerengagement.com Page 10 of 45 Table 7: 2022 Attrition Summary Permanent Removals Opt-Outs Count % Count % T1234 1,170 4.44% 17 0.07% T6 8,058 7.42% 89 0.08% Combined 9,228 6.84% 106 0.08% Overall Attrition Rate 6.92% Table 8: Year Over Year Attrition Opt Out Count Opt Out % Overall Attrition % 2018 172 0.64% 12% 2019 66 0.22% 15.15% 2020 154 0.1% 9.4% 2021 138 0.12% 7.8% 2022 106 .08% 6.92% www.adaptiveconsumerengagement.com Page 11 of 45 Year Over Year Savings Comparisons Table 9: Year Over Year Savings Comparisons T1 T2 T3 T4 T5 T6 Aggregate Savings in kWh Partici pant Count 2018 ____ ____ ____ ____ ____ N/A 3,281,780 23,914 2019 ____ ____ ____ ____ ____ N/A 8,444,746 24,976 2020 1,445,666 1,734,800 1,237,313 881,080 67,831 5,017,703 10,427,940 127,138 2021 183,325 981,868 1,378,427 740,448 100,575 13,382,802 16,767,446 115,153 2022 781,761 238,339 1,113,894 612,969 259,616 17,728,033 20,734,611 104,826 Aggregate Savings in MWh ____ ____ ____ ____ ____ ____ 59,656 N/A Notes on Table 9: ● 2018-2019 savings and participant counts were sourced from IPC’s DSM Reports and/or Pilot Program Summary Reports (PSR). Only the aggregate savings for T1 - T5 were pulled. ● T5 transitioned to residual savings starting from March 2020. ● T6 launched in 2020. www.adaptiveconsumerengagement.com Page 12 of 45 Figure 1: Yearly Aggregate Savings 2020-2022 Note on Figure 1: T5 savings are present in the chart. The savings are so small in comparison to T6 that they aren’t visible. www.adaptiveconsumerengagement.com Page 13 of 45 1. Program Overview 1.1 Team Structure The IPC Home Energy Report program has been a joint eﬀort between Idaho Power Company, Utility Consumer Analytics | N. Harris Computer Corporation (formerly Aclara), and Uplight (formerly Ecotagious) since 2017. Uplight acquired Ecotagious in July of 2019. In June 2021, N. Harris Computer Corporation acquired Adaptive Consumer Engagement (ACE) from Aclara Technologies. 1.2 Objectives 1.2.1 2022 O BJECTIVES The following business requirements were captured during an onsite meeting on August 22, 2019 and documented in the contract as part of the design of this expansion from the pilot project: ● Maximize the total kWh saved, ensuring a UCT of >1 (with a buﬀer), and maintain high customer satisfaction levels. ● Meet cost-eﬀectiveness guidelines from a Total Resource Cost (TRC) and UCT perspective. ○ >1 UCT + buﬀer ● Maintain or enhance the current customer satisfaction levels. ○ Maintain low opt-out rate ○ Drive positive customer interactions ○ Maintain low volume of program-related calls to the Customer Interaction Center ● Average annual savings of 1-3% ○ So long as savings are detectable and statistically signiﬁcant ● Encourage customer engagement with energy usage, including utilization of online tools and lift for other EE programs. 1.2.2 A DDITIONAL O BJECTIVES Monitor persistent savings of T5 group In the expansion program, T5 customers were removed from treatment because their overall usage was low, and they had not achieved statistically signiﬁcant savings in the pilot program. IPC would like to continue to monitor their persistent savings going forward to determine if combining them with the rest of the treatment population could yield additional combined savings. Because the T5 customers received reports through February of 2020, the savings calculated using a diﬀerence-in-diﬀerence methodology can be attributed to treatment in previous years. IPC is working with their third party consultant to identify an appropriate trigger to stop including T5 savings in the aggregate yearly savings estimate. 1.3 Eligibility Screening www.adaptiveconsumerengagement.com Page 14 of 45 1.3.1 E LIGIBILITY S CREENING Eligibility screening for T1, T3, T4, and T5 was initially conducted in year one, and these groups persisted into year two. Eligibility screening for T2 was conducted in year one with the T1 group; however, heating source data for these customers was unavailable until year two, at which time they were re-evaluated for eligibility. The eligibility criteria applied in years one and two were also applied in year three to determine the eligible participants in the T6 group, with new criteria added based on learnings from the pilot. For the expansion in 2020, all T5 and C5 customers were removed from both participation and eligibility based on savings results from the two-year pilot. Additionally, a third party (DNV) randomly removed 29,369 customers from the control groups for Pilot waves 1, 2, 3, and 4 to free them up for possible treatment in the expansion. The analysis by DNV-GL determined how many customers could be removed from these control groups while still allowing for statistical signiﬁcance in calculating savings cumulatively across all treatment groups. In April 2020, eligibility screening was conducted to establish a new T6 group from the remaining Idaho Power customers and those freed up from C1, C2, C3, and C4. Idaho Power scrubbed the initial count of customers and applied the following ﬁlters: IPC Applied Filters are Shown in Table 9 The criteria for culling customers during eligibility screening is shown in Table 9. In late 2020, an issue arose where the benchmarking group for a number of treatment customers fell below the required threshold of 100 homes. Although adequate benchmarking was part of the initial criteria, the size for the benchmarking group during eligibility screening had been set too low. This issue created a situation where customers remaining in the program could potentially receive sporadic reports and have a negative customer experience. As a result, the vendor and IPC made a joint decision to remove participants with inadequate benchmarks from active treatment. At this time, the vendor also conﬁrmed those customers remaining in treatment had enough homes in their respective benchmarking groups to provide quality data for subsequent reporting periods. Table 11: Criteria and Rationale for Culling Customers During Eligibility Screening [removed table for public version] www.adaptiveconsumerengagement.com Page 15 of 45 Figure 2: Eligibility Funnel for 2020 Expansion [removed table for public version] 1.4 Evaluation, Measurement & Verification Process The treatment groups' energy savings were evaluated following standard industry-accepted evaluation practices. The program was set up as a Randomized Control Trial (RCT), with a third party (DNV-GL) randomly assigning the treatment and control groups. The evaluation employed a diﬀerence-in-diﬀerences method, which allows for accurate evaluation of program-driven energy savings. Pilot Year One In year one, appropriately sized treatment and control groups were created for each cohort, assuming an attrition rate of 10 percent and allowing for statistically signiﬁcant detection of energy savings in excess of 1.2 percent in the treatment groups. To achieve this objective, all eligible customers were placed in either the treatment or control group. In year one, 27,000 customers were identiﬁed as initial program participants. After taking into consideration exclusionary factors such as move-ins/move-outs, as well as removing some potential T1 participants due to a lack of adequate county benchmarks, the sample size at the time of the ﬁrst report was 25,677. Pilot Year Two In year two, at the time the bimonthly and monthly groups were created, the total number of customers in treatment groups was down to around 23,000, a net decrease from the previous year. The changes made to the treatment groups were as follows: 1. The T2 group was added to the study. 2. Move-outs were removed from all EMV treatment groups, the rI’m esult of on-going attrition due to customers moving out over the course of year 1. 3. All groups were optimized to remove households with low savings potential. The total number of customers in control groups in year two was 110,969 (down from 166,840 in year one). The same changes made to the treatment groups were applied to the control groups: 1. A new control group was created to accompany the new T2 group. 2. Move-outs were removed from all control groups, the result of on-going attrition due to customers moving out over the course of year 1. 3. The control groups were similarly optimized to remove households with low savings potential. Households where residents moved out during the evaluation period were taken out of both the treatment and control groups for the purpose of measuring energy savings. Customers who opted out or did not receive reports due to being marked non-deliverable by the National Change of Address database were left in both the treatment and control groups for the purpose of measuring energy savings. www.adaptiveconsumerengagement.com Page 16 of 45 2020 Expansion The treatment customers from the pilot continued treatment (except T5) and a new treatment group and new control group were created to expand the number of customers in treatment. After optimization of the existing treatment groups was complete, a total of 18,492 customers were identiﬁed as pilot participants eligible for treatment in year three. The following changes were made to the pilot treatment customers: 1. The T5 treatment group was removed from participation because this group showed the lowest propensity to save energy during the pilot. 2. All remaining treatment customers from the pilot (years one and two) were moved to a consolidated quarterly treatment schedule. 3. The C5 control group was removed from eligibility for treatment. The following changes were made to the pilot control groups: The C1, C2, C3, and C4 control groups were reduced in size signiﬁcantly. 75,973 customers were randomly removed from these four control groups to free them up for inclusion in the T6 experimental design—that is freed up to be randomly allocated to T6 and C6 during the 2020 expansion. The number of customers removed from each control group was determined by DNV-GL with consideration given to the impact their removal would have on the statistical signiﬁcance of calculated savings across all treatment groups. See table 9 for a record of the changes made to the C1, C2, C3, and C4 control groups. Table 12: Reduction in Pilot Control Groups Group Original Control Group Size Reduced New Control Group Size C1 12,090 1,450 C2 5,024 800 C3 35,194 3,520 C4 31,995 2,560 In the spring of 2020, a new wave was created with 108,498 in the treatment group (T6) and 14,744 in the control group (C6) based on eligibility criteria applied to the remaining population. 1.5 Customer Data Acquisition/Integration In the 2022 Program year, there were two improvements made to the program’s data acquisition/integration. The ﬁrst is the quarterly incorporation of updated Do Not Contact (DNC) lists. This was done as part of the eHER expansion eﬀort in August of 2022. IPC provides an updated DNC list once a quarter before eHERs go out. Uplight then cross-references the DNC list with the eHER mailing list and removes any customers that appear on both lists. This ensures that Program www.adaptiveconsumerengagement.com Page 17 of 45 Group customers who ask to be added to Idaho Power’s DNC list are not receiving emails they do not want. The second improvement is the addition of a “hot water heater likely” ﬂag. IPC had collected data on customers likely to have electric hot water heaters. IPC sent the data they collected to Uplight, who then used it to supplement My Account's electric water heater data. Below is the method Uplight used for prioritizing the hot water heater data. 1. If there is no water heater data from My Account for a customer, and there is no data in the “hot water heater likely” ﬁle from Idaho Power, leave it blank. 2. If there is no data from My Account for a customer, but there is data in the “hot water heater likely” ﬁle from Idaho Power, use the hot water heater data from Idaho Power. 3. If there is water heater data from My Account but no data in the “hot water heater likely” ﬁle from Idaho Power, use the hot water heater data from My Account. 4. If there is water heater data from My Account and data in the “hot water heater likely” ﬁle from Idaho Power, prioritize the hot water heater data from My Account. With the hot water heater ﬂag incorporated, enhanced segmentation for customers with and without electric water heaters became possible. In November 2022, we used the new ﬂag to provide money and electricity-saving water tips to customers likely to have electric hot water heaters. To further improve the data and process for future segmentation, Uplight plans to upload the “hot water heater likely” ﬂag directly to My Account using the above-mentioned prioritization. This will not only improve customers’ Proﬁles in My Account, but will allow Uplight to use the existing My Account data export, rather than an ad-hoc process. www.adaptiveconsumerengagement.com Page 18 of 45 Table 13: Data Requirements Integration Point Description Format Frequency Initiator Recipient Public Record Data Aclara calls Melissa Data for latest property records for treatment group customers, selected control customers, and random samples for benchmarking. CSV batch: one-time historical (performed year one) Aclara Aclara Electric Customer-Bill ing Data Idaho Power provides electric customer-billing data for treatment-group customers, selected control customers, and all eligible customers incrementally each week. CSV recurring weekly IPC Aclara Electric Customer-AM I Data Idaho Power provides recurring daily AMI updates of electric AMI data for treatment group customers, selected control customers, and all eligible customers for benchmarking. CSV recurring daily Idaho Power Aclara Action and Proﬁle Data Aclara extracts customer action and proﬁle data from My Account tools (EnergyPrism) for treatment and control group customers. CSV recurring weekly Aclara Aclara Opt-Outs Aclara provides a weekly report on all customer calls and opt-outs to Idaho Power. CSV recurring weekly Idaho Power Aclara www.adaptiveconsumerengagement.com Page 19 of 45 [NEW] Do Not Contact (DNC) List Starting with the August 2022 cycle, Idaho Power provides an updated DNC list once a quarter - prior to reports being sent. Uplight removes customers on the DNC list from the eHER mailing list. CSV recurring quarterly Idaho Power Uplight [NEW] Hot Water “likely list” Idaho Power provided account numbers for customers that are likely to have electric hot water heaters. This data was then used to provide targeted water usage tips for customers that are likely to have hot water heaters. CSV one-time (performed in November 2022 as part of the eHER expansion) Idaho Power Uplight 1.6 Benchmarking Flags Benchmarking ﬂags are used to cluster customers based on similar home properties for the purpose of calculating peer comparisons and identifying how each treatment customer’s usage compares to the average and eﬃcient homes of similar properties. In the pilot program, the ﬂags used to identify benchmarking clusters were 1) Home Size (square feet), 2) Home Type, and 3) County. In the 2020 expansion, two additional ﬂags were added, one for ESH and one for AC. Figure 3 - Peer Comparison Section www.adaptiveconsumerengagement.com Page 20 of 45 1.7 Improving Tip Selection 4. 1.6.1 E NHANCED W ATER H EATER T IPS 5. 1.6.2 O VERVIEW OF SEGMENTATION USED FOR 2022 Idaho Power and Uplight are always on the lookout for new ways to keep report messaging personalized and fresh. This is good way to drive additional customer engagement with intent of increasing program savings and participation. In 2022 the segmentation in Table 14 was used. Table 14: Segmentation Used for 2022 Quarterly Home Energy Reports Report Cycle Segmentation February Electrical Space Heating/Appliances and lights May Air conditioning/Appliances and lights August Air conditioning/Always on November Electrical Space Heating/Appliances and lights/Hot water www.adaptiveconsumerengagement.com Page 21 of 45 2. 2022 Program Results Detail 2.1 Objectives: Findings 2.1.1 E NERGY S AVINGS Cumulative Savings During Treatment Period In total, we saw an average of 200.74 kWh savings per treatment customer. This added up to a total combined savings of 20,474,995 kWh across all treatment groups as of December 31, 2022. Savings calculations from T3, T4 and T6 were statistically signiﬁcant. See table 5 for savings per cohort. The aggregate savings with all groups combined were statistically signiﬁcant. Additionally, the T5 treatment group was treated with home energy reports through February 2020 and did continue to show persistent savings post-treatment. All treatment customers in 2022, including the T5 post-treatment period, showed a total combined savings of 20,734,611 kWh and an average savings of 195.77 kWh per customer . See table 6 for the treatment and persistence savings for the T5 group; and table 7 for combined savings including T5. In tables 5, 6, and 7 we included the Avg kWh Savings per Customer, Average savings percent, and the Cumulative Aggregate Savings (kWh), with IO6 customers included in the Evaluation Group. In 2021, the decision was made to continue including IO6 customers in our Evaluation Group for yearly reporting. www.adaptiveconsumerengagement.com Page 22 of 45 Table 15: 2022 Cumulative Savings Active by Cohort T12346 Treatment Period: Jan 1, 2022 - Dec 31, 2022 Cohort Avg kWh Savings per Customer w/ IO6 Average Savings Percent w/ IO6 95% Conﬁdence Margin of Error w/ IO6 One-Sided Null Hypothesis P-Value w/IO6 Cumulative Aggregate Savings (kWh) w/ IO6 Winter Heating – T1 162.77 0.71% 375.569 0.197821 781,761 Winter Heating – T2 56.71 0.26% 429.37 0.397873 238,339 Year-Round - T3 227.70 1.49% 209.78 0.00166919 1,113,894 Year-Round - T4 267.44 2.47% 188.10 0.002662 612,969 Expansion - T6 206.61 1.35% 71.38 7.00829E-09 17,728,033 Combined 200.74 1.31% 27.28 1.81872E-47 20,474,995 Table 16: 2022 Cumulative Savings by T5 (inactive Cohort) T5 Persistent Period: Jan 1, 2022 - Dec 31, 2022 Cohort Avg kWh Savings per Customer w/ IO6 Average Savings Percent w/ IO6 Cumulative Aggregate Savings (kWh) w/ IO6 Year-Round - T5 66.31 0.89% 259,616 Table 17: 2022 Combined cumulative Savings for all Treatment Groups including T5 Cohort Avg kWh Savings per Customer w/ IO6 Average Savings Percent w/ IO6 Cumulative Aggregate Savings (kWh) w/ IO6 T123456 195.77 1.30% 20,734,611 www.adaptiveconsumerengagement.com Page 23 of 45 2.1.2 M ONTHLY S AVINGS BY T REATMENT G ROUP Table 18: Average kWh Savings per Cohort T1 T2 T3 T4 T6 Jan 2022 -11.37 -8.79 -19.17 -33.16 -16.78 Feb 2022 -26.13 -8.86 -16.42 -31.66 -18.64 Mar 2022 13.19 -23.22 -19.02 -30.32 -13.30 Apr 2022 44.06 -15.70 -12.51 -27.24 -10.15 May 2022 -4.36 -22.75 -16.99 -20.70 -9.78 Jun 2022 -13.22 1.46 -19.79 -16.07 -13.29 Jul 2022 -6.20 -18.41 -29.04 -22.82 -15.15 Aug 2022 -10.39 -5.11 -21.58 -25.87 -14.40 Sep 2022 -7.79 4.77 -16.59 -15.47 -16.06 Oct 2022 -6.69 8.63 -13.68 -11.01 -11.37 Nov 2022 11.68 19.46 -23.58 -21.77 -17.83 Dec 2022 -3.35 -4.07 -29.28 -38.09 -18.44 2.1.3 2022 C OMBINED S AVINGS FOR E XPANSION PARTICIPANTS (T6) V S . P ILOT P ARTICIPANTS (T1234) The T6 group is much larger than other treatment groups and more closely represents the entire Idaho Power customer base than any other group. T6 alone accounts for over 80% of the total treatment group. Savings for T6 have ramped up and are performing well. An analysis of savings within the expansion participant group (T6), compared to the pilot customer group, found that in 2022, T6 saved an average of 206.61 kWh per customer. T3 and T4 continue to outperform T6, while T1 and T2 have underperformed. In aggregate, the active pilot cohorts saved an average of 169.67 kWh per customer and T5 had a residual average savings of 66.31 kWh per customer. The combined average savings for T1, T2, T3, T4, T5, and T6 was 195.77 kWh per customer. 2022 was the second full year where all waves were on the same report schedule, and thus, we are beginning to look at the program group more holistically. www.adaptiveconsumerengagement.com Page 24 of 45 2.2 Email Reports 2.2.1 D ELIVERY , O PEN , AND B OUNCE R ATES In 2022, a total of 99,148 email reports had been sent to Idaho customers and seeds (i.e., IPC employees receiving an eHER to evaluate it). Of these, 97,971 emails were successfully delivered, and a total of 49,617 were opened. This is a 51% open rate which is stronger than average. The total clickthrough rate (that is, the rate of clicks on links contained within the emails) was 2.47%. 2.3 Customer Feedback 2.3.1 C USTOMER S ERVICE L INE C ALLS AND O PT -O UT R ATES Table 19: CSA Calls and Opt-Out Call Rates 2018 2019 2020 2021 2022 Total Calls 411 246 1,087 660 409 Opt-Out Calls 172 66 211 115 93 % of Opt-Out Calls to Total Calls 42% 27% 19% 17% 23% In 2022, IPC customer solutions advisors (CSAs) received 409 calls related to the HER program. Customers must call in to opt out of paper reports, so it makes sense that opt-outs are a notable percentage of total calls. From January to December 2022, CSAs classiﬁed each call they received into one of eight categories as speciﬁed in the table below: ● General ● Proﬁle Update ● Opt-Out ● Escalation ● Non-Program-Related ● Switching to Email ● Switch to Paper ● Other www.adaptiveconsumerengagement.com Page 25 of 45 Figure 4: 2022 Calls by Type www.adaptiveconsumerengagement.com Page 26 of 45 Table 20: – Reasons for Calls to CSAs in 2022 by Category Call Reason 2022 Total Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec General 3 20 5 3 53 2 3 31 3 7 15 1 146 Proﬁle Update — 14 1 — 13 1 — 11 — 5 10 — 55 Opt-Out — 20 2 — 25 1 3 17 2 4 16 3 93 Escalation — — — — — — — — — — — — 0 Non- Program- Related 1 14 8 1 17 5 1 19 1 3 7 2 79 Switch to Email — 6 2 — 5 — — 8 — 3 4 1 29 Switch to Paper — — 1 — 1 — — 1 — — — — 3 Other — 5 1 1 5 — 1 7 — 4 4 1 29 Total Reasons* 4 79 20 5 119 9 8 94 6 26 56 8 434 Total Calls* 4 77 20 4 108 9 7 92 6 23 51 8 409 indicates report month *Some customers call in for more than one reason which is why there is a variance in Total Reasons and Total Calls. www.adaptiveconsumerengagement.com Page 27 of 45 Following are some sample notes from CSAs regarding phone calls from customers about the HER program: ● “[Customer] called advised of needs for more power than others due to caring for her husband in the home..says she will look at the tips and her usage breakdown to see if they can be any more judicious with their usage” ● “[Customer] called we discussed his report..all electric but was not in that category so updated proﬁle to electric heat pump for heating..discussed hot tub added that to proﬁle to..advised how we are determining the usage breakdown” ● “Questions about the accuracy of the report. hasn't ﬁlled out a home proﬁle yet. helped ﬁll it out the generic info” ● “Customer stated he knows he uses a lot of energy, he is an all electric house and has 2 water heaters.” ● “[Customer] called and was added..discussed always on looks like for that time frame a lot of that extra was for xmas lights so would be good to go LED with those and then highest usage Christmas week..advised otherwise looks very good” ● “[Customer] called says got new hvac from El Ada after he called us due to a high HER report last fall..veriﬁed it looks like last couple months have much lower comparative usage than before his new system” ● “Asked about the HER report and went over usage comparison.“ ● “Usage history, helped customer set up MyAccount to ﬁll out the Energy Proﬁle online.” ● “Customer wanted to go over some of the energy eﬃciency options” ● “Appreciates the information!” ● “Inquired about hour Home Energy Audit, also suggested to log into the Home Proﬁle. sent email with some helpful energy-savings tips and Energy Eﬃciency Programs.” www.adaptiveconsumerengagement.com Page 28 of 45 2.4 Additional Metrics 2.4.1 M ICROSITE E NGAGEMENT Table 21: Microsite Activity by Month Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Total Unique Clicks 96 58 43 18 23 17 18 14 11 22 29 74 423 Total Clicks 96 58 43 18 23 17 18 14 11 30 29 74 431 Unique Page Views 19 45 21 26 43 12 22 66 18 116 41 14 443 Total Page Views 19 44 21 28 44 12 28 70 20 141 43 18 488 indicates report month From January 1, 2022 to December 31, 2022, there were a total of 443 unique page views (that is, people who navigated to the site) and 423 unique clicks within the site. Low microsite usage is to be expected, as the site serves only to supplement the HER program and does not oﬀer extra value to customers beyond answering basic FAQs. It is not a venue for customers to update their home proﬁles or opt out of the program; it functions primarily to help reduce call volumes. The microsite link — idahopower.com/HomeEnergyReport — is available from HER reports. www.adaptiveconsumerengagement.com Page 29 of 45 2.4.2 M Y A CCOUNT W EB A CTIVITY Since the beginning of the program, the treatment groups have consistently used IPC’s My Account slightly more than the controls. The treatment group has been an average of 0.07 percent more active on My Account than the controls since January 2017. Figure 5 - My Account Activity Treatment vs Control Program to Date www.adaptiveconsumerengagement.com Page 30 of 45 2.4.3 A TTRITION R ATE D ETAIL HER E XPANSION (T6) A TTRITION R ATES Table 22: T6 Attrition Rates in 2022 T6 Feb May Aug Nov Total Total Reports Delivered 89,025 87,418 85,462 83,674 345,579 Move Outs 385 2,970 1,663 2,187 7,205 Unsupported Rate Code (I06) 192 167 197 194 750 Location — — — — — Property 9 2 — 3 14 Opt Outs 17 23 20 17 77 USPS - Non Deliverables 1 — — — — — Total Permanent Removals 603 3,162 1,880 2,401 8,046 AMI Insuﬃcient/Negative Usage 779 579 653 198 2,209 Insuﬃcient Benchmarking 20 26 28 44 118 Total Temporary Removals 799 605 681 242 2,327 Total Removals 1,402 3,767 2,561 2,643 10,373 1 USPS – Non Deliverables were temporarily removed from eligibility each month; then those customers regained eligibility for treatment the following month until after October of 2020. Starting with the November reports, any customer listed as non-deliverable was permanently removed from the program. In May of 2021 we started treating the undeliverable customers again which is why you see the USPS-Non Deliverables count drop to 0 starting in May. www.adaptiveconsumerengagement.com Page 31 of 45 HER P ILOT (T12345) A TTRITION R ATES Table 23: T12345 Attrition Rates in 2022 T12345 Feb May Aug Nov Total Total Reports Delivered 15,651 15,410 15,105 14,839 61,005 Move Outs 50 435 250 307 1,042 Unsupported Rate Code (I06) 22 25 31 33 111 Location — — — — — Property — — — — — Opt Outs 2 1 6 5 14 USPS - Non Deliverables 2 — — — — — Total Permanent Removals 74 461 287 345 1,167 AMI Insuﬃcient/Negative Usage 92 70 88 31 281 Insuﬃcient Benchmarking 5 7 8 11 31 Total Temporary Removals 97 77 96 42 312 Total Removals 171 538 383 387 1,479 2 USPS – Non Deliverables were temporarily removed from eligibility each month; then those customers regained eligibility for treatment the following month until after October of 2020. Starting with the November reports, any customer listed as non-deliverable was permanently removed from the program. In May of 2021 we started treating the undeliverable customers again which is why you see the USPS-Non Deliverables count drop to 0 starting in May. www.adaptiveconsumerengagement.com Page 32 of 45 3. Process Improvements, Lessons Learned, and Future Considerations 3.1 Process Improvements Midway through the year, it became apparent that the Program was not meeting the previously forecasted savings targets. IPC worked with SilverBlaze/Uplight to explore options for boosting savings while maintaining costs. Two ideas were introduced: 1) Increase HER participant engagement by sending email reports (in addition to paper reports) to all HER participants for which Idaho Power has an email on ﬁle, and 2) Find a way to deliver higher-savings hot water heater tips to participants with electric water heaters. Both ideas had some technical and business challenges that required process tweaks and improvements. Incorporating the Do Not Contact List Quarterly As part of the eHER expansion in August 2022, we updated our cadence to incorporate new Do Not Contact (DNC) lists. Idaho Power provides an updated DNC list once a quarter before eHERs go out. Uplight then cross-references the DNC list with the eHER mailing list and removes any customers that appear on both lists. This ensures that Program Group customers who ask to be added to Idaho Power's DNC list are not receiving emails they do not want. Improved Electric Water Heater Data Idaho Power and Uplight are always on the lookout for new ways to keep report messaging personalized and fresh. This is good way to drive additional customer engagement with intent of increasing program savings. November 2022, a new ﬂag was implemented to provide money and electricity-saving water tips to customers likely to have electric hot water heaters. Previously, IPC had been concerned about sending these tips because customers expect their HERs to be personalized. In addition to creating customer concern about the quality of data driving the reports, sending water-heater related tips to customers without electric water heaters would not have resulted in additional program savings. Incorporating the new data ﬂag allowed us to better target the higher-savings tips while maintaining customers’ trust in the integrity of the data. Idaho Power had collected data on customers likely to have electric hot water heaters. Idaho Power sent the data they collected to Uplight, who then used it to supplement My Account's electric water heater data. Below is the method Uplight used for prioritizing the water heater data. www.adaptiveconsumerengagement.com Page 33 of 45 1. If there is no water heater data from My Account for a customer, and there is no data in the "electric hot water heater likely" ﬁle from Idaho Power, leave it blank. 2. If there is no data from My Account for a customer, but there is data in the "hot water heater likely" ﬁle from Idaho Power, use the hot water heater data from Idaho Power. 3. If there is water heater data from My Account but no data in the "hot water heater likely" ﬁle from Idaho Power, use the hot water heater data from My Account. 4. If there is water heater data from My Account and data in the "hot water heater likely" ﬁle from Idaho Power, prioritize the hot water heater data from My Account. Included NCOA group (USPS undeliverables) in Program Group The inclusion of USPS undeliverables in our Program Group went well in 2022 and is now part of our permanent process. Before May 2021, customers ﬂagged as NCOA/USPS undeliverable were moved out of the Program Group. Since they were retained in the Evaluation Group but no longer received reports, this created the potential for diluting savings. In April, IPC compared the NCOA list with the mailing addresses in IPC’s system and found no explicable reason they should have been removed. At IPC’s request, Uplight developed a solution that allowed us to deliver reports to these participants and keep them in the Program Group. From the May report throughout 2021, Uplight paid ﬁrst-class postage and worked with IPC and the printer to break these customers into their own send list so they could continue receiving reports. Immediately after implementing this process, improvement allowed us to treat an additional 128 customers in May 2021. IPC has not received HERs marked “return to sender” in any notable quantity to date. 3.2 Lessons Learned In 2022 there were several lessons learned. These learnings serve as a way to identify future program improvement opportunities. Bill Ingestor for Program Wasn’t Erasing Email Addresses When eHERs were initially launched, they were only sent to customers who opted into email-only reports. The customer's email address was requested as part of the opt-in process. This ensured that we had the current customer's latest email address. In August of 2022, we expanded eHERs to all customers in the Program Group with valid email addresses. After the ﬁrst cycle of eHERs was sent, we realized that the bill ingestor used for the program was not erasing email addresses from the database when they moved out of a location and became inactive. The ingestor will overwrite the old inactive customer's email address with the new active customers, but only if that email address is not blank. www.adaptiveconsumerengagement.com Page 34 of 45 This became a problem since Service Point ID (SDPID) is the unique primary identiﬁer for a location (e.g., a house). If multiple customers live in a given location over time, one after the other, they will share the SDPID for that location in their billing records. This means that if a customer with an email address moved out of a location and a new one moved in and did not have an email address, the database would store the original customer's email address. As a result, the original customer's email address would receive the eHERs intended for the new, active customer. To resolve this issue, we now only send eHERs to customers we could verify had email addresses belonging to their SDPID in the most recent six weeks of billing data. As part of our standard process, we now validate that we've received billing data for, without an inactive date and with a valid email, since the end of the report window, for all customers receiving eHERs. 3.3 Future Considerations Based on the ﬁndings from 2022, Utility Consumer Analytics/Uplight has the following recommendations for enhancing the program in 2022 and beyond: Silver Blaze/Uplight to Implement Smart Notiﬁcations for CSA Escalations We considered this change in 2022, but decided the cost-beneﬁt was minimal at this time. Overall, the number of HER escalations are low - we’ve seen 23 escalations since 2017. None of those escalations were in 2022, and only 3 of the 23 were in 2021. However, one escalation call received in 2021 brought an opportunity to light. When customers call in with a HER-related escalation, the CSA inputs notes on the call into a CSA survey. From there, the IPC Program Specialist only knows about the escalation through the weekly CSA Report that captures all CSA surveys. Escalations should be responded to quickly. Since the current process relies on a CSA Report, which is pulled once a week, there may be a delay between when the escalation call occurs and when the IPC Program Specialist can act on the escalation. The team concurs it’s in IPC’s best interest to reconﬁgure the CSA survey with “smart notiﬁcation” so that an email is immediately sent to the IPC Program Specialist when an escalation is submitted to Silver Blaze/Uplight through a CSA survey. This will allow the Program Specialist to quickly respond within one business day to any calls marked as an escalation. Uplight is currently investigating the practicality of implementing this change. We are currently manually tracking escalations on a frequent cadence. Add “electric hot water heater likely” data to My Account Now that the electric hot water heater ﬂag is incorporated, enhanced segmentation for customers with and without electric water heaters is possible. In November 2022, we used the new ﬂag to www.adaptiveconsumerengagement.com Page 35 of 45 provide money and electricity-saving water tips to customers likely to have electric hot water heaters. The next step is to upload the “electric hot water heater likely” directly to My Account with the abovementioned prioritization. This will improve customers’ Proﬁles in My Account and allow us to use the My Account data export as the source of truth for the water heater type. Revise How Quarterly Progress to Forecast is Tracked IPC noted that forecast numbers didn't always align with the quarter's savings recorded in the QMR. Uplight explained that there was a method diﬀerence in how the two numbers were pulled and is currently looking into aligning those methods to remove some of the confusion. www.adaptiveconsumerengagement.com Page 36 of 45 4. Appendices 4.1 Appendix A: Sample Home Energy Reports A-1. S AMPLE P RINT HER — A LWAYS -O N T IPS www.adaptiveconsumerengagement.com Page 37 of 45 A-2. S AMPLE P RINT HER — A/C T IPS www.adaptiveconsumerengagement.com Page 38 of 45 A-3. S AMPLE E MAIL R EPORT — A LWAYS -O N T IPS A-4. S AMPLE E MAIL R EPORT — A/C T IPS www.adaptiveconsumerengagement.com Page 39 of 45 A-5. S AMPLE P RINT R EPORT — A PPLIANCES & L IGHTS T IPS www.adaptiveconsumerengagement.com Page 40 of 45 www.adaptiveconsumerengagement.com Page 41 of 45 A-6. S AMPLE E MAIL R EPORT — A PPLIANCES & L IGHTS T IPS www.adaptiveconsumerengagement.com Page 42 of 45 A-7. S AMPLE P RINT R EPORT — H EATING T IPS www.adaptiveconsumerengagement.com Page 43 of 45 A-8. S AMPLE E MAIL R EPORT — H EATING T IPS A-9 Samples print report - hot water tips www.adaptiveconsumerengagement.com Page 44 of 45 4.2 Appendix B: Quarterly Program Monitoring Reports Reports on program metrics were reported on a quarterly basis, according to the schedule below. Report # Date Presented Report Period Q1 May 16, 2022 January 1, 2022 – March 31, 2022 Q2 August 16, 2022 April 1, 2022 - June 30, 2022 Q3 November 15, 2022 July 1, 2022 - September 30, 2022 Q4 February 21, 2023 October 1, 2022 - December 31, 2022 www.adaptiveconsumerengagement.com Page 45 of 45 Idaho Power Company Home Energy Report Program Year 2022 Quarterly Monitoring Report is for Report Period October 1, 2022 – December 31, 2022 Presented on February 21, 2023 Agenda Program Overview Savings Estimates Program Results Microsite and CSA Results Attrition and Opt-outs Questions 2 3 Home Energy Report Program Overview 2022 Program Design 4 Total # of Customers in Quarter Group Customers Eligible to Receive Reports Customers that Received Reports T1 (electric heating) 4,400 4,398 T2 (electric heating) 3,680 3,670 T3 4,616 4,610 T4 2,171 2,164 T6 84,210 83,674 Total 99,077 98,516 Pilot Customers Treated: 14,867 Pulled quarterly after reports are sent. Customers Eligible to Receive Reports is a subset of the Evaluation Group. Some of the eligible customers did not receive reports. Report Schedule 5 2022 Cohort Jan Feb Mar April May June July Aug Sep Oct Nov Dec T1, T2, T3, T4, T6 T5 customers were removed from treatment in May 2020 2023 Cohort Jan Feb Mar April May June July Aug Sep Oct Nov Dec T1, T2, T3, T4, T6 Terminology Program Group The program group is the term we use to refer to customers that are in the treatment group and are actively being treated with reports. These customers by default are also part of the evaluation group. Evaluation Group The evaluation group is the term we use to refer to customers that are in the treatment or control group and are factored into the savings evaluations. These customers may or may not be actively receiving reports. Overview of Waves Wave 1 ●Group 1 = high heating group ●Group 3 = high overall usage group ●Group 4 = medium overall usage group ●Group 5 = low overall usage group (removed) Wave 2 ●Group 2 = high heating group Wave 3 ●Group 6 = all remaining eligible customers (added June 2020) 6 7 Program Savings Summary Q4 Quarterly Savings Summary 8 Cohort Treatment Period Average Energy Savings in kWh per Customer Cumulative Savings (all months, all households, kWh) Percent Savings T1234 October 1, 2022 – December 31, 2022 21.56 344,854 0.83% T6 October 1, 2022 – December 31, 2022 47.60 4,034,857 1.25% T12346 October 1, 2022 – December 31, 2022 43.46 4,379,711 1.18% T1 T2 T3 T4 T6 Treatment 4,730 4,154 4,837 2,272 84,772 Control 1,186 664 2,881 2,135 11,477 T&C counts are for the current quarter only and are captured at end of quarter. This is what we refer to as the Evaluation Group. Customers that moved out before the beginning of the quarter are not included in savings and T&C counts. 2022 Savings Summary 9 Cohort Treatment Period Average Energy Savings in kWh per Customer Cumulative Savings (all months, all households, kWh) Percent Savings T1234 January 1, 2022 – December 31, 2022 169.67 2,746,962 1.08% T6 January 1, 2022 – December 31, 2022 206.61 17,728,033 1.35% T12346 January 1, 2022 – December 31, 2022 200.74 20,474,995 1.31% T1 T2 T3 T4 T6 Treatment 4,803 4,203 4,892 2,292 85,806 Control 1,196 674 2,916 2,158 11,604 T&C counts are for Jan 1st - Treatment Period end date and are captured at end of the treatment quarter. This is what we refer to as the Evaluation Group. Customers that moved out during the Treatment Period are included in savings and T&C counts. 11 HER Program Results Average Energy Savings in kWh per Customer 12 Average Monthly Energy Savings in % 13 Aggregate Monthly Savings 14 Combined Aggregate Savings by Month (kWh) 15 T12346 Peer Comparison Distribution for the November Report 18 Attrition Overview – T1234 19 T12345 Feb2021 May 2021 Aug 2021 Nov2021 Feb2022 May 2022 Aug 2022 Nov2022 2022 Total Total Reports Delivered 16,915 16,652 16,263 15,965 15,651 15,410 15,105 14,839 61,005 Move Outs 269 214 298 271 50 435 250 307 1,042 Unsupported Rate Code (IO6)———103 22 25 31 33 111 Location 100 ———————— Property ——57 —————— Opt-Outs 4 7 1 1 2 1 6 5 14 USPS - Non Deliverables 47 ———————— Total Permanent Removals 420 221 356 375 74 461 287 345 1,167 AMI Insuﬃcient/Negative Usage 65 48 132 105 92 70 88 31 281 Insuﬃcient Benchmarking —4 2 4 5 7 8 11 31 Total Temporary Removals 65 52 134 109 97 77 96 42 312 Total Removals 485 273 490 484 171 538 383 387 1,479 Numbers for current quarter are pulled right before quarterly report generation Attrition Overview – T6 20 T6 Feb 2021 May 2021 Aug 2021 Nov 2021 Feb 2022 May 2022 Aug 2022 Nov 2022 2022 Total Total Reports Delivered 98,238 96,277 93791 91,233 89,025 87,418 85,462 83,674 345,579 Move Outs 1,501 1,702 2,199 2,265 385 2,970 1,663 2,187 7,205 Unsupported Rate Code (IO6)———599 192 167 197 194 750 Location 377 ———————— Property 5 14 24 8 9 2 —3 14 Opt-Outs 38 38 21 28 17 23 20 17 77 USPS - Non Deliverables 314 ———————— Total Permanent Removals 2,235 1,754 2,244 2,900 603 3,162 1,880 2,401 8,046 AMI Insuﬃcient/Negative Usage 513 374 901 996 779 579 653 198 2,209 Insuﬃcient Benchmarking —18 5 19 20 26 28 44 118 Total Temporary Removals 513 392 906 1,105 799 605 681 242 2,327 Total Removals 2,748 2,146 3,105 3,915 1,402 3,767 2,561 2,643 10,373 Numbers for current quarter are pulled right before quarterly report generation Attrition and Opt Out Rates 21 T1234 Customers (January 1, 2022 – December 31, 2022) Permanent Removals 1,170 4.44% Opt Outs 17 0.065% T6 Customers (January 1, 2022 – December 31, 2022) Permanent Removals 8,058 7.42% Opt Outs 89 0.082% All Treatment Customers (January 1, 2022 – December 31, 2022) Permanent Removals 9,228 6.84% Opt Outs 106 0.079% 22 Average Electricity Use Breakdown T12346 July - Sept AL_WH T12346 Nov - March (Previous Winter) ESH 23 Email Open Rates Remain High May 2020 Aug 2020 Oct 2020 Nov 2020 Dec 2020 Feb 2021 May 2021 Aug 2021 Nov 2021 Feb 2022 May 2022 Aug 2022 Nov 2022 Total # of Emails 12 55 75 16 89 106 122 126 153 151 152 52,34845,320 Click-Through Rate 25%7.5%7.7%8.3%22.6%16.5%4.8%6.4%10.4%22%9.9%2.8%2.0% Open Rate 73%73%69%75%70%75%68%75%75%81%73%49%52% Unsubscribe Clicks 0 0 0 0 0 0 3 0 3 5 0 58 42 Unsubscribe Rate 0%0%0%0%0%0%0.8%0%0%1.2%0%0.05%0.02% Click Rate on Rebate Link 0%0%0%0%0%4%0%1.1%0%1.6%1.8%0.72%6.2% •15 total pilot customers switched to email (0.1%) •176 total new customers switched to email (0.16%) •45,320 total emails were delivered in November 2022 2022 Email Click-Throughs 24 Feb May Aug Nov View HTML 9 4 270 169 Feb May Aug Nov Rebates 2 2 187 29 Feb May Aug Nov FAQ 0 0 0 0 Feb May Aug Nov Privacy 2 0 7 2 Feb May Aug Nov Learn More 3 1 30 16 Feb May Aug Nov Unsubscribe 5 0 58 42 Feb May Aug Nov MyAccount 3 3 122 123 25 CSA & Microsite Analysis Call Center Volume Reﬂects Quarterly Schedule 2018 2019 2020 2021 2022 Total Calls*411 246 1,087 660 409 Treatment Month * Some customers call in for more than one reason which is why there is a variance in Total Reasons and Total Calls. Total Call Center Volume down 38% compared to 2021 and 62% from 2020! Call Reason 2022 Total Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec General 3 20 5 3 53 2 3 31 3 7 15 1 146 Proﬁle Update —14 1 —13 1 —11 —5 10 —55 Opt-Out —20 2 —25 1 3 17 2 4 16 3 93 Escalation ————————————0 Non-Program Related 1 14 8 1 17 5 1 19 1 3 7 2 79 Switch to Email —6 2 —5 ——8 —3 4 1 29 Switch to Paper ——1 —1 ——1 ————3 Other —5 1 1 5 —1 7 —4 4 1 29 Total Reasons*4 79 20 5 119 9 8 94 6 26 56 8 434 28 2022 Distribution of Calls by Type Customer Insights and Comments General Questions •“Requested info on energy-savings programs for our residential customers. ” •“[Customer] was concerned that uses 70 percent more over summer AC time. We talked about historical heat wave and isn't directly related to homes in his sub it is the county. We talked about smart thermostat, energy audit and EE tips. They are on well water and retired so home all the time. Didn't want to ﬁll out home proﬁle. Would like to know on report how many homes were in this higher threshold.” •“Wanted to know if any programs available to upgrade home.” •“Gary called showing above average even with new AC and furnace..advised he does pretty good just at the high range of 1k-2k comparison with 1980 sq ft” Opt-outs •“Customer feels the information is inaccurate” •“Customer is planning to move out” Other •“she feels like she is being judged for using too much electricity.” •“[Customer] high eﬃciency showerhead from past kit needs another one. Advised we no longer oﬀer the kits. Recommended researching the brand online or at local hardware store for replacement. It was a High eﬃciency Evolve showerhead with thermostatic shower valve (TSV)” 29 Appendix Attrition Overview Deﬁnitions Unsupported Rate Code: Customers whose rate code is I06. Location: People who don’t have assigned benchmark location due to insuﬃcient benchmarks. In February 2021, customers under this category were permanently removed. Location removals afterwards are temporary and can be tracked under Insuﬃcient Benchmarking.* Property: Customers with unsupported hometype. For T12345, it is home type other than single family home and manufactured home. For T6, it is home type other than single family home. Opt-Out: Customers who opted out. This number is pulled directly from our backend system. USPS - Non deliverables: Customers veriﬁed as undeliverable by USPS. They were not removed from program anymore after 2021 February. AMI Insuﬃcient/ Negative Usage: Customers whose total hourly AMI count is below 90% within report window period or below 97.5% within HoD period (one year); customers whose total usage within window period is negative. Before 2020 June, this category is permanent removals. Afterwards it changed into temporary removals.* Insuﬃcient benchmark: Customers whose benchmark home count is below threshold. These customers are temporarily removed as they could lead to the missing of assigned benchmark location. Benchmarking is related to the home proﬁle information. The HPU is updated every month. If customers or the benchmark homes’ HPU got updated, the benchmarking may become insuﬃcient. For example, if the threshold of benchmark count is 100 homes and one customer has exactly 100 benchmark homes. Once one of the benchmark home’s HPU doesn’t match with the customer home after we update HPU, the customers would be labelled as insuﬃcient benchmark. 34*IPC raised concerns over the usage of permanent vs temporary removals. Work is needed for these deﬁnitions. We will be working together to improve deﬁnitions. Savings Method Change Old Method Prior to Q3 2021, only customers that were active through the end of the analysis period were included in the evaluation group. This means that if a customer moved out in the third month of the quarter, their savings for the ﬁrst two months of the quarter were not measured. New Method Per Craig Williamson’s suggestion, starting in Q3 2021, data for customers who moved out during the analysis period are included up until the date they moved out. This is done consistently for both treatment and control groups. Impact Customers with less than three months will have lower consumption. This (appropriately) leads to a slightly lower average savings per customer, but it increases the total savings, since we are multiplying that average by the total count of customers who were active for any part of the quarter. 35 Statistical Signiﬁcance of Savings Calculated 36 Cohort Average Savings (kWh) per Customer 95% Conﬁdence Margin of Error P-Value of Null Hypothesis being true Statistically Signiﬁcant?Treatment Period T1234 21.56 14.46 0.00173 YES October 1, 2022 – December 31, 2022 T6 47.60 24.91 9.005E-05 YES October 1, 2022 – December 31, 2022 T12346Combined 43.46 9.49 1.42419E-19 YES October 1, 2022 – December 31, 2022 Null hypothesis = no energy savings; Alternative hypothesis = treatment is using less energy than control. Corresponds to a one-tailed test T1 T2 T3 T4 T6 Treatment 4,730 4,154 4,837 2,272 84,772 Control 1,186 664 2,881 2,135 11,477 T1234 Savings Conﬁdence Intervals 37 T6 Savings Conﬁdence Intervals 38 T12346 Savings Conﬁdence Intervals 39