2018 6A State

[MarchingBandNerd]

I saw the video of the Leander and CTJ kids swarming Vista at retreat last night. It made me smile knowing how supportive band kids are towards each other, even when they’re from competing schools!

[Danpod]

I saw the video of the Leander and CTJ kids swarming Vista at retreat last night. It made me smile knowing how supportive band kids are towards each other, even when they’re from competing schools!

It was one of the greatest things I have ever seen on the field.

[SomeBandNerd]

These kids really know how to march AND play!

[Samuel Culper]

I saw the video of the Leander and CTJ kids swarming Vista at retreat last night. It made me smile knowing how supportive band kids are towards each other, even when they’re from competing schools!

I've watched video of it five times now. It was my favorite moment of the entire extended weekend.

[northtexasbandfan]

Congrats to Vista Ridge on taking home the win - they certainly had an incredible show. I didn't see yesterday's run but their performance at BOA SA finals was totally off the charts so it's not surprising. Their rise has been amazing for sure.

 

As for Flower Mound, the senior class this year can lay claim to the following:

 

3 BOA Regional Championships (2015, 2016, 2018)

1 BOA Regional Silver Medal (2017)

3 BOA Super Regional Championships (2015, 2016, 2018)

1 BOA Super Regional top-half-of-finals finish - 6th (2017)

1 BOA Grand Nationals top-half-of-finals finish – 5th (2017)

1 Texas UIL Class 6A Championship (2016)

1 Texas UIL Class 6A Silver Medal (2018)

2 TMEA Class 6A Honor Band 2nd place finishes (2016, 2018)

1 Sudler Shield (2017)

1 upcoming trip to Pasadena, California to participate in the 2019 Rose Bowl Parade and festivities

 

And I’m not even counting things like Birdville, Plano Marching, UIL Region and Area contests.

 

They’ve had one heck of a run.

[Synth_God]

RR 13th

Bowie 17th

Westlake 21st

Hendrickson 25th

How did Hendrickson fall below these groups when they were top 12 in the super regional beating all three of these groups?

[Danpod]

How did Hendrickson fall below these groups when they were top 12 in the super regional beating all three of these groups?

 

Different system.

[Mash]

Congrats to Vista Ridge on taking home the win - they certainly had an incredible show. I didn't see yesterday's run but their performance at BOA SA finals was totally off the charts so it's not surprising. Their rise has been amazing for sure.

 

As for Flower Mound, the senior class this year can lay claim to the following:

 

3 BOA Regional Championships (2015, 2016, 2018)

1 BOA Regional Silver Medal (2017)

3 BOA Super Regional Championships (2015, 2016, 2018)

1 BOA Super Regional top-half-of-finals finish - 6th (2017)

1 BOA Grand Nationals top-half-of-finals finish – 5th (2017)

1 Texas UIL Class 6A Championship (2016)

1 Texas UIL Class 6A Silver Medal (2018)

2 TMEA Class 6A Honor Band 2nd place finishes (2016, 2018)

1 Sudler Shield (2017)

1 upcoming trip to Pasadena, California to participate in the 2019 Rose Bowl Parade and festivities

 

And I’m not even counting things like Birdville, Plano Marching, UIL Region and Area contests.

 

They’ve had one heck of a run.

Congrats to Flower Mound, they had an amazing season and they were spectacular as usual.  Mad props to them!  Nothing to be ashamed of.

 

BTW: here is the final VR run at finals  

[Omega]

The vista ridge band disappearing is awesome! Reminds me of 5A last year when Rouse kids ran across the field to find Cedar Park.

[Samuel Culper]

Looking at the scores, you really gotta wonder about the judge that had Leander 10th in music.  There was a big gap between Leander and Hebron, so it didn't affect placements, but 10th?  Really?

 

The good news is that's really the only goofy-looking outlier.

[Rudedog34]

 

Let's not forget that more judges = more money. They don't work for free.

Exactly. That's why there should be adjudicator accountability. Because it is their job, there should be consistancy in scoring based on "a system that works". Anomalous scores indicate prejudice.

[david19c]

Is 6A state not being factored into Hornrank? Doesn’t make sense for them to use area results but not state results, as I believe that Vista Ridge should be higher than what they’re currently at.

[TWHSParent]

Exactly. That's why there should be adjudicator accountability. Because it is their job, there should be consistancy in scoring based on "a system that works". Anomalous scores indicate prejudice.

 

The only way to back this up is to listen to every single commentary for every single band from the judges to determine if their commentary matches up with their evaluation. So this could be done if UIL chose to do so. If a judge backs up their placement with their commentary, then there is no prejudice against a band, but there might be against a certain style. And that is OK for a judge - they are judging against their preferences within the guidelines set by UIL. Those guidelines don't say "you have to love DCI sounding horn lines" or "you have to love concert band sounding ensembles" or "you have to hate <insert school name>". Do I always like the results? Of course not. I'm still trying to figure out why the VPI judge at GN last year gave us 12th in finals (with a score in the 16 range!?!). He obviously saw something he didn't like (so I assume), but it was an outlier from the previous rounds and the other finals judges. There will always be questions, especially when it goes against your band.

[TWHSParent]

Is 6A state not being factored into Hornrank? Doesn’t make sense for them to use area results but not state results, as I believe that Vista Ridge should be higher than what they’re currently at.

 

Hornrank is BOA focused, with just a little influence from UIL due to the differences between the systems.

[principalagent]

Is 6A state not being factored into Hornrank? Doesn’t make sense for them to use area results but not state results, as I believe that Vista Ridge should be higher than what they’re currently at.

For one, it’s a little more BOA focused a website to make national comparisons easier. And second, the ranking contributions were due before 6A finals ends. Expect some more changes in next week’s ranking. I don’t think Vista will end up lower than 6th.

[TxDragonDad]

Congrats to all the bands who qualified for 6A UIL State competition in 2018!   Wow.  So many talented performers and programs.   Texas reins above all in this regard.   The top bands brought amazing shows and performed them splendidly.  Wow, just wow!    My comments below should not take anything away from those bands.  

 

I've been waiting to decide what to post about all this.  

 

It is no surprise that Round Rock kids are working through the emotions of the reality of the judging scores.   The fact is that 1 judge was 23 rank points away from the average of the other 4 judges and that significance happened to cause them to cross over the finals qualifier threshold.  In fact if J5 had agreed with J4's score, RR would have ended up 10th at Prelims.  Round Rock knew that a Championship was a LONG shot.  But their goal was to make finals at state.   

 

From what I saw, they had a lot of work to do to achieve that goal.  Each performance they brought more to the field.  Their State Prelims run was their best yet.  They truly out marched all the other prior performances.   Those 4 judges' scores validate this truth.   Given BOA Austin Area, BOA SA, they weren't expected to get much higher than 17th at State.  The band had their sites set on 12th, to make finals.   It is such a travesty to watch these excellent performers continue to push and improve toward their goal.   They made huge strides each day.   They were on path to reach their goal   They knew it, too.   Despite being predicted to be somewhere near 17th place, they knew they could achieve higher.  They worked for it.  They had drive and passion.   And according to 4 of the judges, they succeeded!

 

So there we are.  An outlier score.  "Happens every year", so I hear.   Maybe somewhat but 27 rank places delta across the judges, every year?   I may come across emotional.  I am.   But there is some mathematical significance to this situation (see more data below).    This should never happen, to any band, ever again.

 

And if nothing changes in UIL scoring, your child is next to fall victim.    Every parent on here needs to know that it is easy to dismiss as "just how it goes" until it happens to your only child on their senior year.   Just take a moment and let that sink in.   It doesn't matter that it was Round Rock who got hurt this year.  It matters that some band full of seniors got hurt and your child and your band could be next...  unless there is enough support to demand a change.

 

Some have offered up the solution of more judges and throw out top/bottom scores.   The concern with this is cost.   Let's consider this more fully.  Say we want to retain 3 music and 2 marching scores, after throwing out top/bottom from each category.  That means we need to add 2 more music judges and 2 more marching judges, four total.    Just estimating lodging, airfare, and meals, plus compensation for time, I estimate that those four judges would cost about $6k.  If UIL 6A competition has about 1500 paid ticket sales, then ticket prices would need to go up by $4 to cover that additional cost.   So, Moms and Dads - would you pay $4 more per ticket to prevent the outlier problem from happening to your kids' band?    (If ticket sales are 3,000, then that is only $2 more per ticket to cover costs.)   Seems like a feasible suggestion.  

 

Another idea is to use a statistical formula to identify outlier scores and reduce their weight when calculating the final ranking score.   This would require a threshold of defining an outlier and then a sliding scale such that the correction does not overly compensate for the outlier but softens its impact.   This type of approach requires no more judges and basically a single Excel spreadsheet template to interpret the raw scores into judge ranking and adjusted ranking.   I've already drafted one, but need to tweak it some.  (My day job is data modeling and analytics.)   Would UIL be willing to take such a tool and simply enter judges scores (not the rankings) and let the tool soften outlier impact?   They could key in several past event scores to test the tool for "face validity", etc.   Do they want help solving the problem?  Do you want to encourage them to seek a solution?

 

So it comes down to these simple questions:  

1) Are significant outliers a problem?

2) What is significant?  

3) Should UIL Address it?  

4) Should there be an outlier test performed before final ranking?

5) Does it matter more when outliers impact placement across the finals qualifier threshold?

 

IMHO, every band parent and director should want UIL to pursue a solution to prevent outlier impact in the future, especially when it causes finals qualification issues.

 

Respectfully,

TXDragonDad

 

Some data from this year's prelim scoring: 

When comparing the highest judge rank to the lowest judge rank for each band, we get the rank delta for each band.   The average rank delta in prelims was 10.39, and the median was 10.  The top 8 prelim bands all had rank deltas below 10, which suggests high agreement on the quality of their performances.  

 

Round Rock had a rank delta of 27, followed by John Horn with a rank delta of 21.   They were the only two bands with a rank delta above 17.   In this event, anything above 17 appears to be significant.   Round Rock's rank delta was 2.6 times the average & 2.7 times the median.    This is not just a mild outlier situation, but an extreme one.

 

Also, I took each judge's rank and compared it with the average of the other four judges.  I did this for every judge for every band.

J5 was the most significantly out of line.    

   J5's max deviation from average:  23.25 rank places.   (That means J5's rank was 23.25 places away from the average of the other 4 judges!)

   J2 max deviation from average:  12.50  

   The other judges were lower.  

J5 was nearly 2x the outlier of the next judge and of each other judge. 

 

Recall that Round Rock had a rank delta of 27, followed by John Horn with 21 rank spots.   Round Rock lost placements while John Horn gained placements due to outlier impact.

These two bands were exceptionally skewed by a single judge.  In both cases it was J5.  

School    	Judge 1	Judge 2	Judge 3	Judge 4	Judge 5
Round Rock HS 	7	11	11	14	34
John Horn HS  	26	19	31	25	10

Outside of these observations, the rest of the scoring had no hugely significant deltas or outliers.  There were additional "normal" outliers.   

[Mash]

Dragon dad, that seems very thorough and makes sense.  It sounded like Danpod had some connections that could help in the UIL committee.  My gut tells me the committee will just say "This has always worked, why should we change"  but I hope that they will look into how to continually improve the judging. 

 

I am not sure if there are any other ways to make this know in a calm and rational discussion like yours seems to be.   We obviously want to keep the human part of judging in so there has to be a fine line about what can change.  Hopefully they will be able to take your suggestions and from others to tweak the system for the betterment of all the kids in the future.

 

On a side note: Congrats to a great season this year.  The band should hold their head up high no matter what a single judge says.  I know a few kiddos in the Dragon band and I know they are upset and confused about the situation.  

[PSHSMom]

So there we are.  An outlier score.  "Happens every year", so I hear.   Maybe somewhat but 27 rank places delta across the judges, every year?   I may come across emotional.  I am.   But there is some mathematical significance to this situation (see more data below).    This should never happen, to any band, ever again.

 

 

Back in 2012 when PESH made it to state (they made BOA SA Finals that year) they had a judge that marked them next to last in music I believe (so maybe 30th, I don't have the exact data) .  Had it not been for that one score they would have made the finals there too.   It knocked them down to 19th I believe.   Yeah, It would be nice not to see this kind of situation again.   

[TWHSParent]

Since we were the 12th place band in prelims, I've been reluctant to comment. I also have my biases, and I will clearly state that in my opinion Round Rock should not have been in finals over us this year. We were fully expecting that going first with such a deep field in 6A (and I recognize that Cedar Park won 5A last year going first, but 5A lacks the depth of 6A) would be almost problematic. So what's the answer? Take 11th, 12th, 13th, and 14th and have a march off on an even playing field? Top 2 advance? That gets rid of the timeslot issue (and it is an issue - going first will always push a score down in a strongly competitive contest), and allows direct comparison to get the right bands in finals. Congratulations to Round Rock for a very strong push at the end of the season. I've been a fan since I started paying attention to marching band again in 2015. It was especially great to see your program make finals at GN last year - the excitement from your kids was a sight to see. I was excited that our kids put a strong enough performance out there from the 1st slot to stick in the top 12 throughout prelims, and back that up by jumping to 9th in finals (interesting that we were 12th after both prelims this weekend, and jumped to 8th at BOA and 9th at UIL after finals). Everyone did a great job, and it was a pleasure watching the programs put out their best efforts.

[bingogooberman]

i will just say that in a field so deep, so rich in ability, technique, and flat out raw talent, it's incredibly difficult to discern who's better than who or to say that because one judge out of five, and I'll remind everyone that each of them have had long, successful careers in music education and adjudication (one of them was even my high school band director and I trust his opinion implicitly), doesn't agree with the others that they are wrong, or that anyone was wronged. Yes, in an ordinal scoring system, one lower ranking can have a significant impact on your final placement, particularly in preliminary competition where those ordinals can be well into the double digits, but that's just the rules of the game, and looking at the 12 programs that made finals, it's difficult to disagree with the results. I know it stings to be so close to finals and miss, I've definitely been in that spot, but just barely missing finals at this, probably the most challenging marching contest in the nation due to its emphasis on execution and perfection, says more about how amazingly talented the Round Rock band program is than it does about UIL's imperfect scoring system. Also just a side note in J5's defense, it isn't at all surprising to me to see John Horn score in the top 10 visually- that show has compelling, challenging drill that they executed near-flawlessly. 

[LostChoirGuy]

I think it is important to realize that the judges aren't necessarily outliers when they are judging different things. Based on the entire season's results, Round Rock was significantly stronger in music than marching, mostly due to their show not doing them any favors. Also, the two marching judges are positioned on opposite sides of the stadium to watch the performance, so who knows what differences they see in the show.

 

I do think there should be something done to limit these occurrences, but I also think we shouldnt assume that all judges shoukd be scoring the bands the same or even near each other.

 

My freshman year of high school choir, after making it past District, Region, and Pre-Area rounds of All-State, I went to the final round to try to get into the all-state choir. There were 20 people competing for 8 spots and 5 judges scoring us. I got placed 4th, 5th, 11th, 19th, and 20th. I came away very confused about how two of the judges thought I was pretty awful (the last place judge gave me lower scores than I had ever seen before) and how two of the judges thought I was great and easily worthy of making the all-state choir. My choir director talked with me and helped me realize how judges have many different opinions on what makes a beautiful sound and what they are looking for and why that is one of the marverlous things about music. If there was one specific "way to sound good" then we would all be bored and music would lose its power to affect us. She encouraged me to study the judges comments for necessary changes, but to mostly focus on the things that the two judges liked about me because those were my strengths as a musician. This was some of the most valuable advice I ever received and I would not have learned it, at least as early in life, if it wasnt for discrepancies in adjudication.

[Dband2018]

An update: judge 5s main comments on our (round rocks) Tape recording were that we "fluttered too much" and that our skirt "covered our marching".

[Somethingbandrelated]

Honestly, I dont think Vista Ridge was as clean as Flower Mound, the two bands were so close I believe it came down to Flower Mound performing so much earlier.

[LiciaMommycott]

Honestly, I dont think Vista Ridge was as clean as Flower Mound, the two bands were so close I believe it came down to Flower Mound performing so much earlier.

 

 

Proud VRHS mom here and I'm no judge of marching skills and obviously I love my kid's show. However, I really believe the Vista show gripped people this year in such an emotional way that it may have put us over the top. We were glued to the live blog and the love we received from Landry and the Daniels was so amazing to see.  But when Daniel Sanchez said, "That transition back into lost destroys me every single time. There are multiple people up here in the press box with tears," my next thought was "OMG we might have just won it!" That was the point where I thought we could actually take home the gold.  Today the kids listened to the recording of the judges comments in class and the judges were crying during our show. How could a show that moves you so much not get points for that? Maybe I'm wrong, because I know nothing but dang that was one fine show and those kids marched it beautifully! And we started the competition just wanting to make it to finals (speaking as a parent). Being a medal contender was so off my radar.

[scoobydoo]

Area D 2012 a judge made the same comment about Round Rock's leg cape. I hope it wasn't the same judge. RR has had leg capes for 9 years. Maybe a judge like that shouldn't judge marching.