#1  
Old 09-30-2019, 12:49 PM
ChrisWoj's Avatar
ChrisWoj ChrisWoj is offline
Eagle Member
 
Join Date: Nov 2008
Location: Toledo, Ohio
Years Playing: 14.8
Courses Played: 144
Posts: 950
Niced 278 Times in 167 Posts
Default Hole Enjoyment Survey - Creating a measure

Good morning to anyone interested. We started a brief discussion on this project in the Par Talk thread, and it was requested by a few that we break it out into its own thread. What I'm attempting to do is create a measure of hole enjoyment. One of the things we're good at in general with measurement of sensation/experience like this is ranking. What we're bad at is estimating appropriate meaning from the differences in ranking.

This URL takes you to the PDF shared via Google Drive:
https://drive.google.com/file/d/145U...ew?usp=sharing

This is a trial instrument. This instrument isn't a final version. My plan is to trial this instrument at a few local courses. The goal is to identify a set of prompts that function to measure a single construct. Once those have been identified - then the prompts that emerge need to be looked at critically to determine if they are, indeed, looking at the trait we want it to. I will be working with Rasch analysis to convert the results, which are in ordinal form, to something with abstract invariance associated with the intervals. The idea is to create a reasonable facsimile that tells us how much better one hole is than another, in relatively certain terms (key word in there: relatively, I am aware that measuring human sensation is fickle - probabilities are at the core of using this as a measure).

Some things have already been brought up in the other thread:

1. Long term I would like to see this used at multiple courses in regions with more diverse terrain than my home course. That would give me the chance to look at its results alongside the DGCR favorited hole statistics. This helps determine if we have convergent validity - if it functions to rank in a manner similar to the favorite hole scores, we can begin to trust that it is measuring some element of enjoyment.

2. I would also like to compare performance by relevant demographics: how do players at one skill level, or who throw with one dominant throw measure the same holes against others.

3. If what results can be established as a consistent tool, I would like to see it used by players on tour to see how the enjoyment factors line up with some of the numbers others like Steve West have produced on how the holes play.

At the moment, the most important thing is that the survey I'm trialing has construct validity: if, at a glance, an item on the survey doesn't appear to measure in the end some element of enjoyment (or, as one thread refers to it: fun factor) - let me know. This same thought process will be applied after the first analysis is done, but if its clear I chose something really dumb - why include it? So let me know.

Thoughts? Questions? Expletives?
Sponsored Links

Niced: (3)
Reply With Quote
  #2  
Old 09-30-2019, 01:04 PM
DavidSauls's Avatar
DavidSauls DavidSauls is offline
* Ace Member *
 
Join Date: Mar 2008
Location: Newberry, SC
Years Playing: 24.5
Courses Played: 125
Posts: 15,234
Niced 3,538 Times in 1,535 Posts
Default

I'm not sure how you can add it in, but one factor I think of is uniqueness.

Is this hole significantly different, or very similar, to other holes (1) on this course, (2) that I play regularly, or (3) that I have played.

Subjectively, many of my favorite holes stand out because of their unique qualities.

Some of the worst, too, I guess.

Reply With Quote
  #3  
Old 10-01-2019, 10:40 AM
PMantle's Avatar
PMantle PMantle is offline
* Ace Member *
 
Join Date: Dec 2012
Location: Alexandria, La.
Years Playing: 7.4
Courses Played: 48
Throwing Style: RHBH
Posts: 5,068
Niced 846 Times in 575 Posts
Default

Quote:
Originally Posted by ChrisWoj View Post
The goal is to identify a set of prompts that function to measure a single construct. Once those have been identified - then the prompts that emerge need to be looked at critically to determine if they are, indeed, looking at the trait we want it to. I will be working with Rasch analysis to convert the results, which are in ordinal form, to something with abstract invariance associated with the intervals. Questions?
Yes, what line of work are you in?
Reply With Quote
  #4  
Old 10-01-2019, 12:01 PM
ChrisWoj's Avatar
ChrisWoj ChrisWoj is offline
Eagle Member
 
Join Date: Nov 2008
Location: Toledo, Ohio
Years Playing: 14.8
Courses Played: 144
Posts: 950
Niced 278 Times in 167 Posts
Default

Quote:
Originally Posted by PMantle View Post
Yes, what line of work are you in?
Fair question - at the moment I'm an academic and a grill cook. The former a bit more relevant than the latter, though the latter involves walking in circles a lot - apply that how you may.

In terms of academic background - I'm in a PhD Research & Measurement program - basically researching the nuts and bolts of research - primarily focused on development of best practice. Measurement using Rasch is one of the primary focuses of the department, so I get a lot of it. This is more an opportunity to kind of use that in something I enjoy - in a way I want to develop a way to integrate what I enjoy about my professional life into my favorite hobby.

My own focus is on the use of algorithms for sample matching to minimize confounding factors in cases where experimental research is not possible. An example: identifying the success of educational interventions, where I'm looking at broadening our understanding of the appropriateness of using propensity scores and coarsened exact matching as viable strategies. The Pro Tour is getting close to having enough numbers available to match competitors year over year on how they've performed so that we could really discuss the impact of changes to the courses - though I'd still like additional demos like distance, throw/hand dominance, etc. I may look at that in the future.

Overall I'm still kind of feeling out where my hobby and my expertise are going to fit together. I'm hopeful that this project and really yield something fun and lead to a good little extended line of hobby research.

Niced: (1)
Reply With Quote
  #5  
Old 10-01-2019, 12:09 PM
SonicGuy's Avatar
SonicGuy SonicGuy is offline
Double Eagle Member
 
Join Date: Oct 2014
Posts: 1,841
Niced 574 Times in 302 Posts
Default

Quote:
Originally Posted by ChrisWoj View Post
Good morning to anyone interested. What I'm attempting to do is create a measure of hole enjoyment. This is a trial instrument. This instrument isn't a final version. The idea is to create a reasonable facsimile that tells us how much better one hole is than another, in relatively certain terms (key word in there: relatively, I am aware that measuring human sensation is fickle - probabilities are at the core of using this as a measure). I would also like to compare performance by relevant demographics.

Thoughts? Questions? Expletives?
Reply With Quote
  #6  
Old 10-01-2019, 12:21 PM
ChrisWoj's Avatar
ChrisWoj ChrisWoj is offline
Eagle Member
 
Join Date: Nov 2008
Location: Toledo, Ohio
Years Playing: 14.8
Courses Played: 144
Posts: 950
Niced 278 Times in 167 Posts
Default

Quote:
Originally Posted by SonicGuy View Post

Sadly this will prove to be a difficult demo to work with, see attached.
Attached Images
File Type: jpg screenshot-nocoursesinkazak.JPG (92.6 KB, 64 views)
Reply With Quote
  #7  
Old 10-01-2019, 12:24 PM
BuzzzChief's Avatar
BuzzzChief BuzzzChief is offline
Double Eagle Member
 
Join Date: Nov 2014
Location: IL
Years Playing: 17.5
Courses Played: 86
Throwing Style: RHBH
Posts: 1,499
Niced 311 Times in 165 Posts
Default

One thing that I don't see addressed is the "visual appeal" of a hole. I think in most cases, the signature hole at a course is one where there's a dramatic appearance of some kind. A big dropoff, a throw over water from a scenic viewpoint, a unique elevated basket, a rock formation or wood carving, something like that.

For example, DeLa #27 and BRP #4. There are plenty of "top of the world" and tunnel shots out there, but those two are consistently mentioned by people as "favorite" holes. It's because they look cool.

Niced: (2)
Reply With Quote
  #8  
Old 10-01-2019, 12:40 PM
elmexdela elmexdela is offline
* Ace Member *
 
Join Date: Oct 2012
Courses Played: 219
Posts: 8,152
Niced 1,972 Times in 1,134 Posts
Default

Quote:
Originally Posted by BuzzzChief View Post
One thing that I don't see addressed is the "visual appeal" of a hole. I think in most cases, the signature hole at a course is one where there's a dramatic appearance of some kind. A big dropoff, a throw over water from a scenic viewpoint, a unique elevated basket, a rock formation or wood carving, something like that.

For example, DeLa #27 and BRP #4. There are plenty of "top of the world" and tunnel shots out there, but those two are consistently mentioned by people as "favorite" holes. It's because they look cool.
and now all of minnesotas copycat brp 4 style holes that now took away from brp uniqueness
Reply With Quote
  #9  
Old 10-01-2019, 01:19 PM
Hampstead's Avatar
Hampstead Hampstead is offline
* Ace Member *
 
Join Date: Jan 2012
Location: Spaceship Earth
Years Playing: 29.6
Courses Played: 67
Throwing Style: LHBH
Posts: 3,299
Niced 1,718 Times in 558 Posts
Default

Reply With Quote
 

  #10  
Old 10-01-2019, 01:53 PM
Steve West Steve West is offline
Par Delusionary
 
Join Date: Dec 2009
Years Playing: 45.6
Courses Played: 366
Posts: 5,008
Niced 1,713 Times in 841 Posts
Default

If I were forced to never again play one hole of my choosing for the rest of my life, I would gleefully pick BRP 444.

Yet, if I wanted to try to improve the enjoyability of the local disc golf scene by picking holes in the Twin Cities to be eliminated from existence, BRP 444 would be one of the last survivors.

Good luck resolving those ideas into one number.

Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
What is the proper way to measure hole distance? Harpo1989 Course Design 12 06-07-2017 02:12 PM
How to measure hole distance Insomniac General Disc Golf Chat 41 02-24-2016 07:42 PM
Need your help with a short survey to get a new 18-hole course! splatbaseball51 Disc Golf Courses 4 10-22-2015 04:09 PM
Hole Measure Points? DaddyD Course Design 16 05-22-2011 04:32 PM
How to Measure Hole Distances cc0049 Disc Golf Courses 49 11-10-2008 08:28 PM


All times are GMT -4. The time now is 03:51 AM.


Powered by vBulletin® Version 3.8.10
Copyright ©2000 - 2019, vBulletin Solutions, Inc.