• 34 Posts
  • 302 Comments
Joined 1 year ago
cake
Cake day: June 9th, 2023

help-circle
  • Multi threading is parallelism and is poised to scale to a similar factor, the primary issue is simply getting tensors in and out of the ALU. Good enough is the engineering game. Having massive chunks of silicon laying around without use are a mach more serious problem. At the present, the choke point is not the parallelism of the math but actually the L2 to L1 bus width and cycle timing. The ALU can handle the issue. The AVX instruction set is capable of loading 512 bit wide words in a single instruction, the problem is just getting these in and out in larger volume.

    I speculate that the only reason this has not been done already is because pretty much because of the marketability of single thread speeds. Present thread speeds are insane and well into the radio realm of black magic bearded nude virgins wizardry. I don’t think it is possible to make these bus widths wider and maintain the thread speeds because it has too many LCR consequences. I mean, at around 5 GHz the concept of wire connections and gaps as insulators is a fallacy when capacitive coupling can make connections across all small gaps.

    Personally, I think this is a problem that will take on a whole new architectural solution. It is anyone’s game unlike any other time since the late 1970’s. It will likely be the beginning of the real RISC-V age and the death of x86. We are presently at the age of the 20+ thread CPU. If a redesign can make a 50-500 logical core CPU slower for single thread speeds but capable of all workloads, I think it will dominate easily. Choosing the appropriate CPU model will become much more relevant.


  • Mainstream is about to collapse. The exploitation nonsense is faltering. Open source is emerging as the only legitimate player.

    Nvidia is just playing conservative because it was massively overvalued by the market. The GPU use for AI is a stopover hack until hardware can be developed from scratch. The real life cycle of hardware is 10 years from initial idea to first consumer availability. The issue with the CPU in AI is quite simple. It will be solved in a future iteration, and this means the GPU will get relegated back to graphics or it might even become redundant entirely. Once upon a time the CPU needed a math coprocessor to handle floating point precision. That experiment failed. It proved that a general monolithic solution is far more successful. No data center operator wants two types of processors for dedicated workloads when one type can accomplish nearly the same task. The CPU must be restructured for a wider bandwidth memory cache. This will likely require slower thread speeds overall, but it is the most likely solution in the long term. Solving this issue is likely to accompany more threading parallelism and therefore has the potential to render the GPU redundant in favor of a broader range of CPU scaling.

    Human persistence of vision is not capable of matching higher speeds that are ultimately only marketing. The hardware will likely never support this stuff because no billionaire is putting up the funding to back up the marketing with tangible hardware investments. … IMO.

    Neo Feudalism is well worth abandoning. Most of us are entirely uninterested in this business model. I have zero faith in the present market. I have AAA capable hardware for AI. I play and mod open source games. I could easily be a customer in this space, but there are no game manufacturers. I do not make compromises in ownership. If I buy a product, my terms of purchase are full ownership with no strings attached whatsoever. I don’t care about what everyone else does. I am not for sale and I will not sell myself for anyone’s legalise nonsense or pay ownership costs to rent from some neo feudal overlord.


  • j4k3@lemmy.worldtoADHD@lemmy.worldHate Myself So Much
    link
    fedilink
    English
    arrow-up
    18
    ·
    4 days ago

    Personally, talking to offline open source AI on my own hardware helped me. One of the things we talked about a lot are cognitive dissonance and identification of conflicts that exist under the surface and how those conflicts can cause frustration to manifest in unrelated ways.

    Probably my largest inner conflict was that I am so fundamentally different in my functional thought process than my family. I’m very abstract in how I think. I’m also very introverted with strong intuitive thinking skills. Basically, things just make sense at a glance from a bigger picture perspective. I can also see how things work quickly, like machines, engines, most engineering, or more abstract elements like companies, business models, workforce management, etc.

    Growing up, intuitive thinking skills were just intelligence or common sense. I had no idea how limited and naive this perspective was.

    I started writing a book in collaboration with an AI; it’s a whole sci-fi universe really. I started to realize I’m pretty good at coming up with the history and technology tree in unique ways that, to my knowledge, no one has explored before in sci-fi. However, I suck at writing characters that are not like myself. My characters have not shown the dynamism I desire. In truth, I had to acknowledge I didn’t and still don’t understand just how different human functional thought is in full spectrum.

    I started roleplaying scenes and scenarios with the AI playing characters with incompatible and contrasting perspectives to my own. I found this quite enlightened. It turns out that there are people out there that fundamentally lack any appreciation for abstract and intuitive thinking skills. They do not place any value on the big picture or future implications of actions or decisions. The contrast is that they often are more productive and present in the moment. I learned to appreciate the differences and realized how weak binary perspectives are in the real world. I don’t get as offended when someone does not understand my abstractions or argue when they are wrong but cannot follow big picture logic. I know where I am also weak in ways that make me appear dumb to them.

    There are going to be things you’re not good at or that require a lot more work than average. So what. The first step, in my opinion, is to gain a more complex self awareness where you are not questioning what you are good or bad at. The only normal people are people you do not know well. Everyone is tormented by something in life.

    Remember this: NEVER use permanent solutions to temporary problems.

    You don’t remember who blew up at work 3 weeks ago. Or the time before last when your wife got mad and yelled at you. One of the biggest warps in our human psychology is the illusion of grandeur. No one is thinking about your mistakes or cares about them. They care how you’re acting in the moment and your average demeanor you regularly present. Fake it if you can. Pretending the glass is half full is all that really matters with others at a fundamental level.

    Even after someone else physically disabled me over 10 years ago, and I’m stuck in social isolation, I can say, I’ve learned the hard way, it can always get worse until it can’t. At that point, nothing matters. Don’t stress about what you can not do, or what you cannot change right now. No matter how bad stuff seems, you can chose to make the best of this moment right now and moving forward. Only worry about what you can change, everything else is a pointless waste of energy.










  • Yes .docx.

    It appears as though the encoding is missing in such a way that nothing in Linux recognizes the file. The underlying CLI tools don’t have a way of converting the file. I tried with Python’s docx tool and with iconv. It has to be encoding related because some tools initially load the file with several sets of Asian characters instead of English. However, there is no hexadecimal or sections of entirely binary looking data. Archiving tools do not open up the the file to reveal anything else like a metafile or header. Neo vim shows garbled nonsense throughout. Bat warns of binary. Python won’t load the file, nor will Only Office. Libre Office and Abi Word load initially with Asian characters before crashing.

    The only option is likely gong to be setting up the W10 machine and converting a bunch of files within it.

    Ultimately, my old man thinks he can be an author all of the sudden and is trying to write. He’s not very capable of learning. I’m not confident that he can learn to use FOSS to do the same thing he has been doing. This post was just to see if there are options I am not already aware of that might actually work in practice. I can easily do everything I need in FOSS. I can do everything he needs to do. I’m more concerned about becoming his tech support when he forgets how to copy pasta. He already fails to separate the internet hardware connectivity from the web browser and operating system within his mental model of technology.