Canadian Government Executive - Volume 23 - Issue 07

October 2017 // Canadian Government Executive / 27 Association Spotlight Infographic 2 – Canadian Evaluation Society - MembershipMatters Evaluators evaluating themselves! Infographic 1 illustrates key characteristics associated with mem- bership in CES associated and practicing evaluation. What is note- worthy is the proportion of respondents who worked in evaluation for ten years or less slightly outnumber those who have been work- ing in the field for over ten years. The survey revealed that there was an even split between evaluators who spend three-quarters of their work time on evaluation, and those who spend less than three-quarters of their work time on evaluation. This may reflect the evolving nature of what are considered “evaluation-related” ac- tivities. No doubt, the breadth of Canadian evaluation practice is expanding. This is all the more evident as demand increases for “evaluative thinking” and ancillary capacities in program manage- ment - performance measurement, monitoring and Deliverology. Survey says … Examining Infographic 2, three-quarters of those surveyed (405 CES members - 30% response rate) expressed satisfaction with the efforts of their Society. Virtually all intend to renew their mem- bership. This is most encouraging as it reflects continuing com- mitment to both the profession and the association, but why do people join the Society in the first place? The main reasons are to acquire professional development and to belong to a commu- nity of practice. Professional development is believed to be critical to the role of an evaluator; rated so by roughly three-quarters of respondents/members. Again, this is unsurprising when viewed alongside other trends. For example, as of April, 2017, there were 197 “Credentialed Evaluator” applications in the CES pipeline. Taken together, the survey confirms that CES is fulfilling its role in effectively advocating for increased awareness and understand- ing of the use of evaluation. While the above results are descrip- tive, there is an opportunity to conduct further analysis, especially in identifying the drivers of engagement. What pushes members toward further professional development? Why become a creden- tialed evaluator? This may be the subject of follow-on analysis. Future unfolding, as it should As an organization, CES is trying to balance both its purpose and relevance. It continues to recognize specialization, something re- flected in highly technical and scientific branches of inquiry with deep roots in economics, education, health and psychology (ran- domized control trials). Yet, CES must also remain adaptive and open. New trends and emerging perspectives require drawing on experimental and evolving methods such as rapid assessment techniques, developmental evaluation or cultural and participa- tory process outcomes (evaluation as change). Such is the reality of a professional association: to build social networks and to lead by supporting its community of practice. It is a very Canadian way. The CES is learning about itself, by discussing and testing its opportunities. In moving forward, CES will continue to reflect, engage and in- form on the implications of these survey results. In an era of popu- lism, wonky polls, and anti-science tendencies, the value of rigor, inclusiveness, multi-disciplinarity, and user-focused methods are all the more needed. The implications may mean better engage- ment of newer members; reconnecting with those expressing low- er levels of satisfaction; not losing touch with more experienced older cohorts of evaluators; or expanding and diversifying mem- bership. Encouraging more collaboration between provincial and territorial chapters, as well as closer engagement with the national organization, continues to be on the radar screen. Building Cana- dian partnerships with neighboring organizations (e.g. Canadian research networks, universities, media) also shows much poten- tial. Overall, CES is becoming a more effective communicator in its outreach activities, especially with non-evaluators; those “not in the room”. The bottom line is that the survey results do con- firm membership engagement. As professionals, program evalua- tors are taking a keen interest in the future of their organization. They continue to provide financial resources and volunteer time to make their association better. In fact, members’ interests, expec- tations, concerns and vision mirror the very health state of evalu- ation in Canada. However, an ambitious agenda lies ahead. This can only be good news, particularly for those who consume and use evaluation research; the very readers of this magazine. J acob M. J ohann , M.A.P. is a Chair at CES Communications and Marketing Committee, Professionnel de recherche, Observatoire québécois de l’adaptation aux changements climatiques, Faculté des sciences de l’éducation, Université Laval, johann.jacob@fse.ulaval.ca . W ayne M ac D onaldis a Vice-President at Canadian Evaluation Society (CES) - New Brunswick Chapter, President, Infinity Consulting and Legal Services (CLS), wayne.macdonald@rogers.com. R ebecca M ellett is an Executive Director at Canadian Evaluation Society, rebecca_mellett@ evaluationcanada.ca Infographic 2 CES Membership Matters Advance Professionalism Increase Evaluation Value Engage, Grow & Diversify Membership say professional development is the top membership benefit with high levels of satisfaction in this area. 75% “Dues” (& Don’ts) vs. Preferred Learning Methods Roster of CE’s (41%) CES Mentoring Initiative (41%) % of those who agree there is good value in paid dues. CES Membership Matters - Key Research Findings* - * Source : Online National CES Membership Survey of 405 members conducted by Probe Research Inc. between October 6th and October 27th, 2016. Member Benefits Chapter Learning Events (77%) Annual CES Conference (74%) CES webinars (74%) 78% of CE’s feel engaged 32% of new members are not engaged Levels of Member Engagement 42% of members who feel CES is doing a good job expanding and diversifying membership. of members believe CES is doing a good job promoting evaluation theory and practice. 66% 47% of members joined CES because they feel a membership gives them credibility. Members who said “None”: 1% Individuals have different levels of engagement with CES. Would you say you are….. 25% of respondents are considering applying for their Credentialed Evaluator (CE) designation. How soon? JOIN TODAY! Providing professional development opportunities Developing a community of practice Advocating for increased awareness and use of evaluation Developing network opportunities Providing high quality programs and services to members Face-to-Face Online webinars Onlineself-directed courses BlendofOnlineand Face-to-Face More Valued Less Valued 1-2years 48% Innextyear 23% Don’t Know 18% 2+ years 48% Very Engaged 21% Somewhat engaged 38% Neutral/Unsure 16% Not very engaged 21% Not at all engaged, 6% GOOD JOB! 81% Senior Members: 30% Students:

RkJQdWJsaXNoZXIy NDI0Mzg=