{"id":481,"date":"2006-01-27T15:22:23","date_gmt":"2006-01-27T22:22:23","guid":{"rendered":"http:\/\/www.redmonk.com\/jgovernor\/wp\/?p=481"},"modified":"2006-01-27T15:22:23","modified_gmt":"2006-01-27T22:22:23","slug":"what-do-numbers-analysts-do-anyway-on-quantitative-research","status":"publish","type":"post","link":"https:\/\/redmonk.com\/jgovernor\/what-do-numbers-analysts-do-anyway-on-quantitative-research\/","title":{"rendered":"What do &#8220;numbers&#8221; analysts do, anyway? On quantitative research"},"content":{"rendered":"<p><DIV>When I started bashing together a series of articles on <A href=\"http:\/\/www.redmonk.com\/jgovernor\/archives\/001220.html\">how to become an industry analyst<\/A>                it rapidly became obvious I don&#8217;t have all the experience required to fill out the picture sufficiently.<\/DIV><DIV>&nbsp;<\/DIV><DIV>I have never worked for a numbers company like IDC or Dataquest, so what do I know about that part of the industry?&nbsp;Not much.&nbsp;Of course though, what really matters is not what you know, but who you know. <\/DIV><DIV>&nbsp;<\/DIV><DIV>I therefore asked <A href=\"http:\/\/freeformcomment.blogspot.com\/\">Dale Vile<\/A> , founder of <A href=\"http:\/\/www.freeformdynamics.com\/\">Freeform Dynamics<\/A> to put together a guest post. <\/DIV><DIV>&nbsp;<\/DIV><DIV>We haven&#8217;t formally announced anything yet, but RedMonk will be partnering with Freeform Dynamics this year. It has numbers and research methodologies. We have insights, contacts and communications skills. <\/DIV><DIV>&nbsp;<\/DIV><DIV>A <A href=\"http:\/\/www.redmonk.com\/sogrady\/archives\/000241.html\">binary view<\/A>   holds that market research is either quantitative or qualitative. Of course&nbsp;the most analytical value is created by a combination of both &#8216;q&#8217;s, where insights based on experience are also tested broadly.&nbsp;&nbsp;My experience is 95% qualitative, but one of the arguments Dale makes in the post is that really good quantative research analysts will also be good at market view and qualitative insight, which explains why analysts are generally better at industry market research than PR companies. <\/DIV><DIV>&nbsp;<\/DIV><DIV>I split Dale&#8217;s writeup into two pieces &#8211; this is the first one, What Do Numbers Analysts Do?<\/DIV><DIV>&nbsp;<\/DIV><DIV>So without further ado&nbsp;&#8211; here is Dale:<\/DIV><DIV>&nbsp;<\/DIV><DIV><P><EM>As James and I were chatting recently, it became clear that whilst we both call ourselves analysts, there are some important differences in what we do and how we spend our time. James therefore asked me to put a few thoughts together on the role of a quantitative research analyst, (or &#147;numbers analyst&#148; as he calls it) and how to become one.<\/EM><\/P><P><EM><\/EM><\/P><P><EM>So, to begin with, what do us numbers guys do?<\/EM><\/P><P><EM><\/EM><\/P><P><EM>At a simplistic level, we design and execute surveys, then analyse and interpret the results, which may then be used as input into business planning and development activity or as the basis for market analysis reports and advisory services. It sounds relatively straightforward and at a high level it is, but the devil is in the detail, so it&#146;s worth talking through the process to get a feel for the kinds of things a numbers analyst needs to deal with. <\/EM><\/P><P><EM><\/EM><\/P><P><EM>Given a particular requirement or brief, for example, the first challenge is designing the study. Considerations here are sampling of target respondents, qualification of respondents for inclusion in the study, positioning of the interview, and method of execution (face to face versus telephone versus online).<\/EM><\/P><P><EM><\/EM><\/P><P><EM>All of these have an impact on the result. To use a an extreme case to illustrate the point, if the objective is to investigate a particular aspect of Linux and you use an online survey enticing people to participate by saying &#147;Give us your views on Linux in the context of &#133;&#148;, Linux advocates will be much more likely to respond than sceptics or agnostics. This gives you a skewed sample which clearly means it is invalid to subsequently say things like &#147;X% of companies think Linux is great for &#133;.&#148;. However, in a study of this nature, if you have asked the right questions, you would be able to make statements confidently and legitimately about those with experience of relevant use or differences in perceptions between users and non-users.<\/EM><\/P><P><EM><\/EM><\/P><P><EM>And this brings us on to the important area of questionnaire design. This is a massive topic and anyone on the receiving end of a poorly designed questionnaire executed by a pure market research company will understand this. In IT related research, questionnaires really need to be designed by industry analysts with a knowledge of the area being investigated, a feel for how the data will ultimately be analysed, and experience of &#147;choreographing&#148; the interview flow in a way that builds rapport and elicits unambiguous answers. <\/EM><\/P><P><EM><\/EM><\/P><P><EM>Execution is a topic I won&#146;t go into here (i.e. the project management and operational side of actually gathering the data), but suffice it to say that this is pretty involved and unless it is handled well, the end result is likely to be compromised.<\/EM><\/P><P><EM><\/EM><\/P><P><EM>Finally, a numbers analyst will work with the data, analysing the obvious, but also looking for those trends and correlations that provide the real insights into what&#146;s going on. Again, this can only be conducted effectively by an industry analyst with the necessary industry knowledge, otherwise important findings are missed and\/or observations are misinterpreted &#150; a common occurrence, for example, when PR companies engage generic market research firms and come out with ludicrous headlines for press releases.<\/EM><\/P><\/DIV><DIV><EM><\/EM>&nbsp;<\/DIV><DIV><EM><\/EM>&nbsp;<\/DIV><DIV><EM><\/EM>&nbsp;<\/DIV><\/p>\n","protected":false},"excerpt":{"rendered":"<p>When I started bashing together a series of articles on how to become an industry analyst it rapidly became obvious I don&#8217;t have all the experience required to fill out the picture sufficiently.&nbsp;I have never worked for a numbers company like IDC or Dataquest, so what do I know about that part of the industry?&nbsp;Not<\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","footnotes":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false},"categories":[1],"tags":[],"class_list":["post-481","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_featured_media_url":"","jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p9wfjh-7L","_links":{"self":[{"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/posts\/481","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/comments?post=481"}],"version-history":[{"count":0,"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/posts\/481\/revisions"}],"wp:attachment":[{"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/media?parent=481"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/categories?post=481"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/tags?post=481"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}