Business is booming.

The hidden ‘replication crisis’ of finance

77


It may sound like a low-budget Blade Runner rip-off, but over the past decade the scientific world has been gripped by a “replication crisis” — the findings of many seminal studies cannot be repeated, with huge implications. Is investing suffering from something similar?

That is the incendiary argument of Campbell Harvey, professor of finance at Duke university. He reckons that at least half of the 400 supposedly market-beating strategies identified in top financial journals over the years are bogus. Worse, he worries that many fellow academics are in denial about this.

“It’s a huge issue,” he says. “Step one in dealing with the replication crisis in finance is to accept that there is a crisis. And right now, many of my colleagues are not there yet.”

Harvey is not some obscure outsider or performative contrarian attempting to gain attention through needless controversy. He is the former editor of the Journal of Finance, a former president of the American Finance Association, and an adviser to investment firms like Research Affiliates and Man Group.

He has written more than 150 papers on finance, several of which have won prestigious prizes. In fact, Harvey’s 1986 PhD thesis first showed how the bond market’s curves can predict recessions. In other words, this is not like a child saying the emperor has no clothes. Harvey’s escalating criticism of the rigour of financial academia since 2015 is more akin to the emperor regretfully proclaiming his own nudity.

To understand what the ‘replication crisis’ is, how it has happened and its implications for finance, it helps to start at its broader genesis.

Line chart showing how live performance of many ETFs fails to live up to model's promise

In 2005, Stanford medical professor John Ioannidis published a bombshell essay titled “Why Most Published Research Findings Are False”, which noted that the results of many medical research papers could not be replicated by other researchers. Subsequently, several other fields have turned a harsh eye on themselves and come to similar conclusions. The heart of the issue is a phenomenon that researchers call “p-hacking”. 

In statistics, a p-value is the probability of whether a finding could be because of pure chance — a simple data oddity like the correlation of Nicolas Cage films to US swimming pool drownings — or whether it is “statistically significant”. P-scores indicate whether a certain drug really does help, or if cheap stocks do outperform over time. 

P-hacking is when researchers overtly or subconsciously twist the data to find a superficially compelling but ultimately spurious relationship between variables. It can be done by cherry-picking what metrics to measure, or subtly changing the time period used. Just because something is narrowly statistically significant, does not mean it is actually meaningful. A trading strategy that looks golden on paper might turn up nothing but lumps of coal when actually implemented.

Harvey attributes the scourge of p-hacking to incentives in academia. Getting a paper with a sensational finding published in a prestigious journal can earn an ambitious young professor the ultimate prize — tenure. Wasting months of work on a theory that does not hold up to scrutiny would frustrate anyone. It is therefore tempting to torture the data until it yields something interesting, even if other researchers are later unable to duplicate the results.

Obviously, the stakes of the replication crisis are much higher in medicine, where lives can be in play. But it is not something that remains confined to the ivory towers of business schools, as investment groups often smell an opportunity to sell products based on apparently market-beating factors, Harvey argues. “It filters into the real world,” he says. “It definitely makes it into people’s portfolios.”

AQR, a prominent quant investment group, is also sceptical that there are hundreds of durable and successful factors that can help investors beat markets, but argues that the “replication crisis” brouhaha is overdone. Earlier this year it published a paper that concluded that not only could the majority of the studies it examined be replicated, they still worked “out of sample” — in actual live trading — and were actually further corroborated by international data.

Harvey is unconvinced by the riposte, and will square up to the AQR paper’s authors at the American Finance Association’s annual meeting in early January. “That’s going to be a very interesting discussion,” he promises.

Many of the industry’s geekier members will be rubbing their hands at the prospect of a gladiatorial, if cerebral, showdown to kick off 2022.

Email: robin.wigglesworth@ft.com

Twitter: @robinwigg



Source link

77 Comments
  1. JedidiahRiver says

    thank you so much for this impressive site me and my family precious this message and perceptiveness

  2. Mrrplp says

    levofloxacin 500mg us levofloxacin online

  3. Gqrcvl says

    order avodart 0.5mg online cheap buy avodart online purchase zofran sale

  4. Jbrojy says

    spironolactone 100mg for sale buy valacyclovir 500mg online fluconazole 100mg canada

  5. Dpzbmj says

    buy acillin generic bactrim buy erythromycin generic

  6. Gfkxum says

    fildena 100mg sale careprost allergy nasal spray robaxin medication

  7. Dotshi says

    suhagra 100mg canada estradiol 1mg without prescription estrace 1mg usa

  8. Qzhqlu says

    order lamictal 50mg generic lamotrigine buy online retin gel canada

  9. Gkkmwj says

    buy tadalis 10mg pills avana 200mg ca buy generic diclofenac

  10. Dbxiyx says

    isotretinoin 10mg sale amoxil without prescription purchase zithromax for sale

  11. Mxkqrp says

    tadalafil 10mg without prescription best natural ed treatment sildenafil uk

  12. Lejiza says

    arimidex 1mg brand generic viagra trusted site order sildenafil 100mg

  13. Dhuhqu says

    cialis 5mg generique pas cher sildenafil 50mg pas cher viagra 50mg gГ©nГ©rique

  14. Wzdjfa says

    order prednisone 10mg online cheap prednisone drug sildenafil uk

  15. Evvsua says

    cialis 10mg generika viagra 50mg generika rezeptfrei kaufen viagra 50mg kaufen für männer

  16. Rbpknp says

    buy doxycycline pill levitra over the counter generic furosemide

  17. Mgbhhq says

    order altace pills order irbesartan generic order astelin 10 ml

  18. Mbcjfm says

    purchase catapres online catapres online order spiriva 9 mcg without prescription

  19. Fybetq says

    buy buspirone 10mg generic buspirone 5mg oral oxybutynin over the counter

  20. Vrdpcl says

    terazosin 1mg ca buy arava 20mg online cheap cheap azulfidine

  21. Phjktt says

    fosamax 70mg pill buy ibuprofen 600mg generic famotidine 20mg uk

  22. Gfauwo says

    buy olmesartan 20mg buy olmesartan 10mg pills cheap diamox 250mg

  23. Scgbpm says

    buy prograf 1mg online cheap labetalol 100 mg urso uk

  24. Tfqpft says

    imdur sale imdur order online telmisartan 80mg cheap

  25. Kaflny says

    zyban 150 mg generic bupropion price seroquel 100mg sale

  26. Bfiblv says

    molnupiravir oral omnicef order online purchase lansoprazole generic

  27. Mmjlrt says

    order sertraline 100mg buy lexapro 10mg pills buy sildenafil 100mg for sale

  28. Mlqyfz says

    salbutamol 100mcg cheap sildenafil 50mg generic sildenafil online

  29. Hbdbtg says

    tadalafil 40mg brand viagra tablets in chennai oral viagra 100mg

  30. Wjwdql says

    guaranteed cialis overnight delivery usa cialis drug symmetrel pill

  31. Axavkb says

    revia 50mg cheap order letrozole without prescription abilify 30mg canada

  32. Pyolwd says

    purchase medroxyprogesterone without prescription microzide sale generic cyproheptadine 4 mg

  33. Wfqwuz says

    order modafinil 200mg sale oral stromectol ivermectin tablet price

  34. Gypdub says

    buy fluvoxamine online cheap luvox 100mg order glucotrol 10mg online cheap

  35. casinosite says

    I’ve been looking for photos and articles on this topic over the past few days due to a school assignment, casinosite and I’m really happy to find a post with the material I was looking for! I bookmark and will come often! Thanks 😀

  36. Sithrq says

    brand isotretinoin 10mg prednisone 5mg usa deltasone for sale online

  37. Gsyudz says

    piracetam buy online viagra 50mg tablet sildenafil india

  38. Tgncrn says

    order zithromax 500mg pills order generic neurontin 100mg gabapentin price

  39. Sepjto says

    purchase cialis generic cialis 5mg viagra overnight shipping usa

  40. Sywokg says

    cheap furosemide 100mg order hydroxychloroquine generic buy plaquenil 200mg generic

  41. Sewcvo says

    order cialis 5mg pill generic betnovate buy anafranil pills

  42. Ncumpa says

    chloroquine price baricitinib 4mg brand baricitinib 4mg canada

  43. Jwnwxo says

    sporanox 100 mg oral buy tindamax 300mg online cheap tindamax 300mg pills

  44. Fnvave says

    buy glycomet 500mg generic buy cialis 20mg pill buy cialis 5mg online cheap

  45. Zehcpr says

    zyprexa cheap nebivolol 5mg sale cheap diovan 80mg

  46. Uelhfw says

    order norvasc online viagra drug cialis pills 5mg

  47. Huuvok says

    clozapine 50mg over the counter brand ipratropium 100mcg order decadron 0,5 mg generic

  48. Nejmjf says

    purchase sildenafil pill oral sildenafil 100mg order lisinopril 10mg online

  49. Ppufyq says

    generic omeprazole buy prilosec 10mg online slot games

  50. Bqmtmb says

    order zyvox 600mg free poker online games play for real online casino games

  51. Ihvwrw says

    order lopressor 50mg generic buy levitra 20mg for sale vardenafil 10mg us

  52. Itzmyt says

    paper writing online win real money online casino casino online usa

  53. Usrdqa says

    vardenafil 10mg uk order levitra 10mg methylprednisolone 8mg without prescription

  54. Rzmash says

    get assignments done online purchase viagra online viagra 200mg

  55. Vqqsnc says

    buy clomiphene 100mg pills order clomid 100mg online play poker online real money

  56. Nipwdo says

    triamcinolone 10mg tablet claritin for sale clarinex 5mg usa

  57. Ugsamm says

    order priligy 60mg sale oral priligy 90mg synthroid 100mcg for sale

  58. Emapzn says

    cialis 10mg oral viagra tablets viagra cost

  59. Ahyvwy says

    brand orlistat purchase orlistat online cheap acyclovir 400mg tablet

  60. Jzafux says

    tadalafil 10mg tablet plavix 75mg oral clopidogrel sale

  61. Kniruf says

    buy allopurinol generic order crestor 20mg pills cost zetia

  62. Jycmzx says

    domperidone pills order cyclobenzaprine without prescription buy flexeril 15mg sale

  63. Wumkff says

    losartan price buy losartan topamax drug

  64. Pbakko says

    buy baclofen 10mg pills buy toradol 10mg online cheap buy toradol 10mg for sale

  65. Aldlbg says

    imitrex order online buy imitrex 50mg pill cost dutasteride

  66. Pdbspj says

    gloperba for sale free slots casino games casino play

  67. Xzgejp says

    blackjack online for real money hard rock casino online online blackjack free

  68. Qdjxyt says

    tamsulosin 0.4mg without prescription cheap flomax aldactone 25mg us

  69. Ohndem says

    cialis australia cialis 10mg cost order cipro 1000mg online cheap

  70. Todyts says

    cheap simvastatin 10mg order proscar 1mg generic order generic finasteride 5mg

  71. Gjchjl says

    order metronidazole 400mg generic buy flagyl 400mg online cheap sulfamethoxazole over the counter

  72. Vltcru says

    order diflucan 100mg online cheap sildenafil 100mg pills for sale buy viagra 50mg pill

  73. Xprzjx says

    brand keflex 500mg order generic erythromycin erythromycin 250mg for sale

  74. Qbxlkg says

    tadalafil 40 mg brand tadalafil 5mg cheap sildenafil sale

  75. Fuuqmz says

    sildenafil for sale order sildenafil 50mg for sale cialis from canada

  76. Hwonvz says

    ceftin tablet robaxin uk order robaxin generic

  77. Mtwfqa says

    best online gambling sites online roulette game tadalafil for sale

Leave A Reply

Your email address will not be published.