Nxt Forum

Please login or register.

Login with username, password and session length
Advanced search  

News:

Latest Nxt Client 1.11.10 - NEW RELEASE: Ardor 2.0.5e TestNet - The Ignis ICO is over!! Ardor genesis snapshots will happen at Nxt block 1,630,000 (expected for 25th December)

Pages: [1]

Author Topic: AssetGraphs.py is born!  (Read 2433 times)

altsheets

  • Board Moderator
  • Full Member
  • ****
  • Offline Offline
  • Posts: 232
  • check out #AAssetNXT #AltFolio and #AssetGraphs
    • View Profile
    • AssetGraphs-v2 live examples
  • Karma: +31/-1
AssetGraphs.py is born!
August 08, 2015, 09:10:49 pm

AssetGraphs.py is born!


An unforgettable weekend: I survived my 1st hackathon :-)

[Tons of text following, and not sorry for that. As short as possible, but as long as necessary. Until this is solved, I suggest you press 'CTRL +' a few times. Shorter rows are easier for your brain.]

incomplete TOC: medium future


AssetGraphs.py visualizes markets as network graphs.
(buyer --> assets --> shareholders) is one of the first graphics - many more are to come.

Complex Networks have a revive in physics since the late 1990s when large empirical networks were discovered to be (almost always) scale-free, clustered and small-world. Mathematics had founded the basic concepts of Graph Theory with (Euler in 1736). Sociology (in the early 20th century) had coined the term SNA "Social Network Analysis", and developed a vast vocabulary and numerical methods to study such graphs.
But with modern computers and data now easily available on the internet, the powerful methods proved more versatile than only analyzing social situations; there are tons of applications now in different departments, from gene regulation in biology, over food networks in ecology, to analyzing the source code tree of the whole Apache server project as one graph.

The amazing API of NXT is just perfect for applying the same method to blockchain data. Essentially all entities (accounts, assets, trades, aliases, ...) do connect other entities in some way or another. And whenever there are two entities that are connected, then between the nodes we can draw a so called edge which links the two nodes. Do that for many nodes, and voilà - a graph appears that gives us an object to study the structure of the whole collection - and for some extreme cases (i.e. small graphs, with few nodes & edges), even pictures can be drawn - that well feed the pattern recognition system in our brain, i.e. we can get an immediate intuitive understanding of complex objects.

With rather dry statistical methods I had been analyzing assets for a while now (assetparser.py), simply because I wanted to understand the field better before I launched my first own assets (AAssetHZ, AAssetNXT). Please buy some - they crowdfund the initial work that I am putting into my projects (the first ~ready one is AltFolio - a portfolio overview spreadsheet, with price update dataserver backend - "all your coins on one page; save time every day; react faster to sudden changes"), and will pay dividends from the future profits of all my projects, e.g. the serial code fees of AltFolio.

NxtHacks 2015
... but now to this project, assetgraphs. More intuitive ways to complement the descriptive statistics of my assetparser.py had always been my dream, so with the nxthacks there was a good opportunity to try and create the initial architecture to do so. The advantage of a hackathon (it was my first one!) seems to be that we get from zero to something useful in a very short time. Honestly, for the same product, I would have needed weeks otherwise; because I tend to be a perfectionist, and thus would have built the whole thing slowly, with a focus on abstraction, and recycleability. And who is a coder might understand me: To start a brand new project is postponed many times, just because we know there will be plenty of follow-up work, and we don't want to neglect our existing projects too.

The biggest advantage of a hackathon is its disadvantage - the time constraint: What I don't finish within 48 hours, won't be in there. Well ... it turned out, that when I cut down on the scope of previously imagined functions (see medium future below) ... I am able to combine abstraction and recyclability with the limited time, and still get a fully working first version of assetgraphs: Including API access, data retrieval and cleaning, connectivity analysis, generating a network file, understanding a d3 code snippet, rendering the graph image, presenting on a webpage - all done as new code, in crazy 24 of the 48 hours (read my enthusiastic report after I had slept for ages).

Check out my results: http://altsheets.ddns.net/assetgraphs

Vote now!
My most urgent plea to you now is:
... that you quickly get an understanding of what assetgraphs is doing, and what all of us 6 contestants have created.
... and then quickly cast your vote in the nxthacks voting. My -also brand new- countdown image (put it on your webpage?)



Voting happens in your wallet, and will cost you 1 NXT:
NxtWallet --> Voting System --> Nxthacks Hackathon Voting --> Vote
(put that into your signature for 4.3 days ?)


The near future
Monetization of my work is of paramount importance (or I must leave cryptos, and "sell myself to the machine" *g*).

A new asset is to be issued (first ideas during  the hackathon).
General idea: When that asset is fully sold,
all source code is published, which then provides
the groundwork to a platform for creating your
own networks from blockchain data easily.
! -> New forum topic - post asset comments to that thread !

My hackathon presentation is also a "proof-of-concept" for what is to come.

The sourcecode needs:
Cleaning up,
refactoring,
separating modules,
abstracting the graph generator from the linked entities,
replacing ad-hoc decisions with sustainable solutions
= deciding the general architecture.

This project can become huge, so taking time for the cleverest possible choices of the basic structure now ... will pay off in the end.


The medium future
There are natural next steps, only some examples:
  • Weighted edges everywhere:
    the example graph 1 already shows that data can live on the edges between nodes.
  • Expanding the network:
    When I doubleclick on any node, it expands, and adds its neighbours to the picture.
  • Data Panel:
    When I click on account nodes ... I see NXT balance, name & description, last active, etc..
    When I click on asset nodes ... I see e.g. the issuance text (simply as hover-over the big blue node).
  • Clustering
    Nodes that are more densely connected to each other than to all others, are called clusters.
    There is a whole machinery of algorithms ... that generate coloured nodes - depending on their 'home' cluster.
  • Projecting onto one partition:
    When two assets share the same buyers, we can directly connect these asset nodes by edges.
    Deleting the shareholder nodes, we get a projection onto the asset node partition, with then only one type of nodes.
    I am really looking forward to seeing all 578 assets in one picture!
  • Time evolution:
    Imagine the network starts building up in order of the originating transactions.
Are you intrigued by these ideas?
Are you a good, and focused coder (Python, JavaScript, d3, Neo4j, Java, ...)?
Do you want to learn more (or already know a lot) about Graph Theory, Complex Networks, or SNA?
Can you already imagine to fly through your own asset-shareholders-accounts-aliases-currencies-marketplace-... network pictures?

Then why not join me in implementing this project.

The far future
Here the funding comes in again. I am open to everything that redirects existing money-streams into our project: Asset-financed sourcecode. Membership concepts. Newest features to paying customers only. Pay-per-view. Pay-per-network-creation. Monthly fees. Venture Capital. Research grants. Some rich benefactors. Whatever (please add more). Or a clever combination of all those? Because money is fungible, as long as it does arrive, it doesn't really matter where it comes from - unless it is the military ;-)

Provided we find some stable way to generate income, all the amazing methods of SNA sociology & Graph Theory mathematics & Complex Networks physics can be applied to blockchain data. And a future wallet might look very, very different from what you are downloading now. -->

"All software is a preview."  (AltSheetsDev, 8/8/2015 :) )

Words from this thread, as a word cloud

rendered by a d3 plugin by Jason Davies

Hooked?
I suggest these early books about the topic - I remember the first one to not even show one mathematical formula (only in footnotes). Very readable, especially for (explaining all this to) less technical people.
  • Linked: The New Science Of Networks Science Of Networks, 2002, by Albert-Laszlo Barabasi,
    + the Barabasi/Albert research 1999 article which kind of kicked all this alive (arXiv:cond-mat/9907038)

  • Small Worlds: The Dynamics of Networks between Order and Randomness, 1999/2003, by Duncan J. Watts
    + the Watts/Strogatz research 1998 article which kind of kicked all this alive :-) (Nature 393, 440–442 (1998))
Wikipedia pages are good starting points too: Graph Theory (mathematics), SNA (sociology), Complex Networks (physics).

What now?
If you enjoyed reading this, you can give back with whatever-suits-you-best:
* become a shareholder of my existing assets: AAssetNXT or AAssetHZ.
* (free) try and (cheap) buy my software useful for altcoin traders: AltFolio.
* cast your vote in the NxtHacks 2015 (forum, homepage, voting booth, results)
* Retweet my enthusiam, and follow me on twitter (@altsheets), or diaspora  (/u/altsheets), or
* join my downline in the brand new StartPeeps (facebook clone but better ;) ), or
* below post ideas, feedback, criticism, praise, ...

... or simply send some donation, every bit (or quant) counts: NXT-CMKU-ZQYK-V6CD-9UHF4

Thanks for your time, and attention. Enjoy your hackathon-free weekend

 8)
« Last Edit: November 05, 2015, 10:50:26 pm by altsheets »
AltFolio | Newbium DataSite | AAssetNXT & -HZ | AssetGraphs | ABEE | Advice | assetparser.py & shareholders.py | bamm.py | PeerCrawler | Github e.g. ChainCountDown, ethjsre | ... much more

altsheets

  • Board Moderator
  • Full Member
  • ****
  • Offline Offline
  • Posts: 232
  • check out #AAssetNXT #AltFolio and #AssetGraphs
    • View Profile
    • AssetGraphs-v2 live examples
  • Karma: +31/-1
Re: AssetGraphs.py is born!
August 08, 2015, 09:21:49 pm

.
AltFolio | Newbium DataSite | AAssetNXT & -HZ | AssetGraphs | ABEE | Advice | assetparser.py & shareholders.py | bamm.py | PeerCrawler | Github e.g. ChainCountDown, ethjsre | ... much more

altsheets

  • Board Moderator
  • Full Member
  • ****
  • Offline Offline
  • Posts: 232
  • check out #AAssetNXT #AltFolio and #AssetGraphs
    • View Profile
    • AssetGraphs-v2 live examples
  • Karma: +31/-1
Re: AssetGraphs.py is born!
August 15, 2015, 05:15:26 pm


______________________
Hooray!

nxthacks2015 - and .. we have a winner:

1st:  AltSheets with AssetGraphs.py

AltFolio | Newbium DataSite | AAssetNXT & -HZ | AssetGraphs | ABEE | Advice | assetparser.py & shareholders.py | bamm.py | PeerCrawler | Github e.g. ChainCountDown, ethjsre | ... much more

altsheets

  • Board Moderator
  • Full Member
  • ****
  • Offline Offline
  • Posts: 232
  • check out #AAssetNXT #AltFolio and #AssetGraphs
    • View Profile
    • AssetGraphs-v2 live examples
  • Karma: +31/-1
Re: AssetGraphs.py is born!
August 17, 2015, 09:38:56 pm


A new thread to collect momentum to carry this into the future:

https://nxtforum.org/index.php?topic=9798

Thanks!
AltFolio | Newbium DataSite | AAssetNXT & -HZ | AssetGraphs | ABEE | Advice | assetparser.py & shareholders.py | bamm.py | PeerCrawler | Github e.g. ChainCountDown, ethjsre | ... much more

altsheets

  • Board Moderator
  • Full Member
  • ****
  • Offline Offline
  • Posts: 232
  • check out #AAssetNXT #AltFolio and #AssetGraphs
    • View Profile
    • AssetGraphs-v2 live examples
  • Karma: +31/-1
Re: AssetGraphs.py is born!
August 25, 2015, 07:15:40 pm

Words from this thread, as a word cloud



rendered by a d3 plugin by Jason Davies
AltFolio | Newbium DataSite | AAssetNXT & -HZ | AssetGraphs | ABEE | Advice | assetparser.py & shareholders.py | bamm.py | PeerCrawler | Github e.g. ChainCountDown, ethjsre | ... much more

altsheets

  • Board Moderator
  • Full Member
  • ****
  • Offline Offline
  • Posts: 232
  • check out #AAssetNXT #AltFolio and #AssetGraphs
    • View Profile
    • AssetGraphs-v2 live examples
  • Karma: +31/-1
Re: AssetGraphs.py is born!
December 07, 2015, 08:51:36 pm

Milestone!

1st customer served!

I have just sold a "buyer perspective" app of assetgraphs-v2.

Yiehah!   :)  ;)  :D  ;D  8)


-----
Edit: retweet
« Last Edit: December 07, 2015, 08:56:13 pm by altsheets »
AltFolio | Newbium DataSite | AAssetNXT & -HZ | AssetGraphs | ABEE | Advice | assetparser.py & shareholders.py | bamm.py | PeerCrawler | Github e.g. ChainCountDown, ethjsre | ... much more

noashh

  • Hero Member
  • *****
  • Offline Offline
  • Posts: 808
    • View Profile
  • Karma: +74/-17
Re: AssetGraphs.py is born!
December 08, 2015, 06:24:42 am

Milestone!

1st customer served!

I have just sold a "buyer perspective" app of assetgraphs-v2.

Yiehah!   :)  ;)  :D  ;D  8)


-----
Edit: retweet


Congratulations :-)

altsheets

  • Board Moderator
  • Full Member
  • ****
  • Offline Offline
  • Posts: 232
  • check out #AAssetNXT #AltFolio and #AssetGraphs
    • View Profile
    • AssetGraphs-v2 live examples
  • Karma: +31/-1
Re: AssetGraphs.py is born!
December 15, 2015, 05:21:57 pm

Milestone!
1st customer served!
I have just sold a "buyer perspective" app of assetgraphs-v2.
Yiehah!   :)  ;)  :D  ;D  8)
-----
Edit: retweet

Congratulations :-)

Thanks a lot, noashh. Interested to buy your personalized toy, too?
AltFolio | Newbium DataSite | AAssetNXT & -HZ | AssetGraphs | ABEE | Advice | assetparser.py & shareholders.py | bamm.py | PeerCrawler | Github e.g. ChainCountDown, ethjsre | ... much more
Pages: [1]