Power BI Exchange

Please login or click SIGN UP FOR FREE to create your PowerBIUG account to join this user group.
Expand all | Collapse all

Duplicate data from Dataflow

  • 1.  Duplicate data from Dataflow

    Posted Oct 04, 2019 06:00 AM
    Hi Community

    I have Power Bi Desktop September 2019 release and experience issues loading one of our Dataflows.

    The Dataflow has no duplicates when previewed in the Query Editor, yet in the report itself when fully loaded, has duplicates when using a Table visual and in the Dataset View too so nits not the visual itself.

    I am about to open a support call with Microsoft to remedy this.

    Has anyone else also experienced this ?

    Thanks
    Jude

    ------------------------------
    Jude Moore

    ------------------------------


  • 2.  RE: Duplicate data from Dataflow

    Silver Contributor
    Posted Dec 07, 2020 01:51 PM
    I know you posted this some time ago, but I have similar issues on one specific report that I've never been able to figure out. Only thing on mine is that it is sporadic and it doesn't always have duplicates when refreshed, even though the data is relatively static and impossible to have duplicates in the source system. I've verified the source has no duplicates and cannot replicate on desktop, only about 20% of time while refreshing in the service do I encounter.

    Did you find any resolution or work arounds?

    ------------------------------
    Mike Kromminga
    Data Architect | ITA Group
    ------------------------------



  • 3.  RE: Duplicate data from Dataflow

    Top Contributor
    Posted Dec 08, 2020 03:25 AM
    Edited by Gopa Kumar Sivadasan Dec 08, 2020 03:28 AM
    Hi @Jude Moore

    Normally, Query editor loads 1000 rows. Whereas your table in pbix has all the rows. So, if the duplicate occurs outside of the sampled data in query editor, you may experience what you see. Did you check whether in source data there are duplicates? ​If there are no duplicates in source as @Mike Kromminga faces, then I am not sure what could be the reason.

    ------------------------------
    Gopa Kumar
    Limner Consulting

    North Kerala User Group Leader
    https://www.pbiusergroup.com/NorthKerala
    ------------------------------



  • 4.  RE: Duplicate data from Dataflow

    Posted Sep 13, 2021 11:01 AM
    Resurrecting an old thread, I just encountered this issue, in my case it was due to incremental refresh. Turning off IR refreshing the table then turning it back on fixed things

    ------------------------------
    Phil
    ------------------------------