Llama 2 rtx 3060 mining reddit. I wanted to test the difference between the two.

Llama 2 rtx 3060 mining reddit 2 or Xwin 70B models a try. Also, the RTX 3060 12gb should be mentioned as a budget option. 45 - $2. The larger the amount of VRAM, the larger the model size (# of parameters) you can work with. Sorry for the total noob post. My very rough guess My GPU is mining ETH and my CPU is mining Monero. 0 MH - ALPH Subreddit to discuss about Llama, the large language model created by Meta AI. 3060+3070/80 or better go with same 3060 - with same gddr6. 23 GiB already allocated; 0 bytes free; 9. Bought it for 600€ in Europe and profitable for Wow, it got it right! localmodels. 5 on mistral 7b q8 and 2. In my experience, large-ish models (i. It’s also on average 90% faster than the Pascal GeForce GTX 1060 which was one of NVIDIA’s most popular cards that launched at the bargain price of $249 four and one-half years ago. Within the last 2 months, 5 orthagonal (independent /r/StableDiffusion is back open after the protest of Reddit killing open API access, which will bankrupt app developers, hamper moderation, and exclude blind users from the site. I agree with you if I wanted to make a multi gpu mining rig your methods would work much better. SLI went on the way of the dinosaurs. With 1000 GB/s memory bandwidth, it is faster than an RTX 3090. Tried to allocate 86. (Palit cards are garbage for mining) But at least now you know your sweet spot is under 1400 so anything close to 1400 will be good and don't forget to check after few hours of mining if you have rejected shares Another thing is, that new RTX 3060 with GDDR6X (bigger bandwidth) is coming - so it will depend on the second-hand market here, but I expect prices of "old" 3060 and others will go even more down than it's now and will think and compare - if will be ok to have two different cards - e. Or check it out in the app stores Is the RTX 3060 with 12GB of RAM not able no run a 13B model? (**make_quant_kwargs) File “D:\Text_generation_Web_UI\text-generation-webui\repositories\GPTQ-for-LLaMa\quant. On my RTX 3090 setting LLAMA_CUDA_DMMV_X=64 LLAMA_CUDA_DMMV_Y=2 increases performance by 20%. 2-2. Note that llama. Just running 20 batch in RTX 3060 12GB, got 6-7 iterations per second, so noticable faster compared to my RTX 3050Ti 6GB VRAM in my laptop Asus VivoBook Pro. Open comment sort options. I've managed to get one (On the rush to not lose by the bots I bought the 3060 thinking it was a 3060Ti But I think 3060 will give more tokens per second than 4060 TI for models that are under 12GB, and will be significantly cheaper. I had a gtx 1070 8gb vram before and it runs out of vram in some cases. Yes, that's what many people do, used mining rigs with lots of pcie slots come in very handy for this purpose 1660 Super, 3060 RTX 12gb or 4060 RTX 8gb for a computer with i5-10600k Hi, just thought I'd share my OC settings on an Asus RTX 3060 TUF GAMING OC 12G GDDR6 GPU in my gaming PC that I use for mining in spare time. If you need the best OC settings for rtx3090ti in mining pls check them here - https://calc. I was told that some people really like them as they do not need as many power plugs. 05 driver I've tried using this card in my main slot, secondary & tertiary slot, even tried it on a different motherboard - yet it still retains the 21mhs hashrate. Or check it out in the app stores My 3060 maintains 68C with the fan on 75% and the case open on these settings and another card warming it up. Then I found the link for the 470. With exllamav2, 2x 4090 can run 70B q4 at 15T/s. Members Official Reddit of UnMineable. TL;DR: If you have AMD Radeon Aug 27, 2023 · RTX 3060 12 GB (which is very cheap now) or more recent such as RTX 4060 Sep 30, 2024 · After exploring the hardware requirements for running Llama 2 and Llama 3. I prefer this rtx 3060 NON LHR low hashrate . 5 TB/s bandwidth on GPU dedicated entirely to the model on highly optimized backend (rtx 4090 have just under 1TB/s but you can get like 90-100t/s with mistral 4bit GPTQ) If you’re mining on hive, I think it’s double what the windows memory offset it. You can get a used 3090 for ~$680, especially an ex-mining card. 24 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory I set one of the 3060 Ti and 3070s to +150, and the other at a fixed core clock of 1650. GeForce RTX 4060 Ti vs. Then I realised it needs to be plugged in with a dummy Get the Reddit app Scan this QR code to download the app now. for past 6 months . Power at 120-130 watts or lock core around 1350-1450. 8-1. 00 GiB total capacity; 9. Now my power decreased to below 60w and hashrate to 25-26mh/s. come on man this is LLM not gpu-mining, have some class /s Reply reply Zotsc GEFORCE RTX 3060 12gb random 3 shorts beeps upvote r/radeon. 70 MH/s. The Radeon Subreddit - The best place for discussion about Radeon and AMD products. with the 3090 you're paying a premium for optimisations that focus on gaming and crypto mining. I need a multi GPU recommendation. Hey guys. 2 MSI GF75 sitting in tent position with a Noctua fan attached to the air intake on the back. com/tloen/llama-int8 by @tloen that uses INT8. i’m using rtx 3060 colorful igame ultra white I just found the Reddit post with 1k+ likes and chose the google drive download link. I am using an RTX 3060 LHR for mining and I was getting around 33mh/s at 115w. Used RTX 30 series is the best price to performance, and I'd recommend the 3060 12GB (~$300), RTX A4000 16GB (~$500), RTX 3090 24GB (~$700-800). View community ranking In the Top 1% of largest communities on Reddit. Even when SLI was a thing, depending on the titles that supported it at the time you either saw a none/little or a lot of performance gain. 3060 non ti is made on a separate smaller gpu die, with narrower vram bus. 28 RTX 3080 TI - $6. Until then, please utilize the resources in the MINING WIKI for additional useful guides and information. 66 MH/s -> 48. com/ggerganov/llama. Hello fellow Miners! I have a quick question about the plugins and mining in general with a RTX 3060. NiceHash is a Bitcoin centered platform, providing a complete ecosystem of mining and BTC payment services with the goal to accelerate Bitcoin adoption worldwide. I was initially stuck with an 3060 mining at half its speed cause it was in a x4 lane pcie slot. It seems like I am missing a couple of MHs because as soon as I open the window and put the PC right next to it it jumps up RTX 3060 ti produces a few more mh/s and now at the current price of ETH that is an extra $250 per year with stock settings and with the extra 6 mh/s you literally get the price difference for the electricity back in 1 month. Or check it out in the app stores   probably better to go with a RTX 3060 12GB. QUESTION Ok so basically I've bought a 3060 LHR. 2 and 2-2. Internet Culture (Viral) and the last component for my build is a GPU. 1 cannot be overstated. The importance of system memory (RAM) in running Llama 2 and Llama 3. Or check it out in the app stores does anyone knows if the 3060 12 gb edition worth a shot for mining? and what is the performance with respect to the 3060 ti? ive read this on some website " Even though the RTX 3060 has a higher memory capacity, its overall bandwidth is low Get the Reddit app Scan this QR code to download the app now. 832 MH/s, PL 60, core clock -502 ( GPU reads 990-1042 MHz), Memory clock +1020 ( MEM reads 8321 MHz) Fan speed 80%, GPU Temp. A GTX Titan X Pascal does about 40-50t/s on Llama 3 8B Q4KM GGUF in Aphrodite. Subreddit to discuss about Llama, the large language model created by Meta AI. 149K subscribers in the LocalLLaMA community. I see a vendor in my city with 10 used (RTX 3090) cards, 2 used for mining and 8 used in gaming cafes. Valheim; Genshin Impact; RTX 4060 Ti 8 GB vs RTX 3060 Ti 8 GB which one is a better card performace wise, keeping aside the price? Archived post. At first I got around 20 Mh/s. So 2400 - 2600 memory offset or +1200 to 1300. As for which 3060 Ti is best for mining? You really can't be picky, getting anything is really hard right now. late to the discussion but I got a 3060 myself because I cannot afford 3080 12gb or 3080 ti 12gb. Using the Nvidia GeForce 470. I do not use quickminer. 6 hash. What to mine and nicehash profitability show 40/41 hash at their website. cpp. I am surprised at the difference in settings required for the two Get the Reddit app Scan this QR code to download the app now. Easily enlarge up to 1024x1024p Now, I am reading about xformers. cpp), and converted the base models Jul 20, 2023 · Using llama. Or check it out in the app stores Using 2 x Nvidia RTX 3060 cards on an sli mobo with 2 x P104-100 cards and this is what im getting on the 3060s: with antec HCG 750W gold. 30 days is like $210 revenue & at a power consumption of 110w it's 80kWH/mo, at $0. LLM360 has released K2 65b, a fully reproducible open source LLM matching Llama 2 70b 3060 ti is a cut down 3070, and it mines the same as 3070 due to same 8gb 448gb/s vram. And at the moment I don’t have the financial resources to buy 2 3090 and a cooler and nvlink but I can buy a single 4090. 46. 47. Or check it out in the app stores     TOPICS. Gaming. 1. 47 RTX 3070 TI - $3. If you have any experiences of using xformers, please kindly share to me. I have a fairly simple python script that mounts it and gives me a local server REST API to prompt. Or check it out in the app stores   I've recently tried playing with Llama 3 -8B, I only have an RTX 3080 (10 GB Vram). 2x Instinct Mi50 are with 32 GB faster and larger **and** cheaper than an RTX 3090. USED Asus P9X79 E-WS MOBO 2 Gigabyte 3060 3 Zotac 3060 1 Inno 3d 3060 Get the Reddit app Scan this QR code to download the app now. Skip to main content. Or check it out in the app stores   Rtx 3060 or 3050 for a laptop ? upvote LLM360 has released K2 65b, a fully reproducible open source LLM matching Llama 2 70b Gegabyte OC : Nvidia Geforce RTX 3060 w/ 470. Access to the model: To work with Llama 2, you will need to request access through the following steps: Tested all my LHR cards with BzMiner mining ALEPHIUM. Get the Reddit app Scan this QR code to download the app now Mining with ASUS ROG Strix RTX 3060 12GB . py”, line 446, in make_quant make_quant(child, names, bits I couldn't load it fully, but partial load (up to 44/51 layers) does speed up inference by up to 2-3 times, to ~6-7 tokens/s from ~2-3 tokens/s (no gpu). But when I run my miner on it while charging, it shoots up to Get the Reddit app Scan this QR code to download the app now. ;) P. Absolutely you can try bigger 33B model, but not all layer will be loaded to 3060 and will unusable performance. 1) or second (rev. I've quantized a number of the good models at ~2. The only downside is it maxes out at about 140t/s with batching instead of the 280t/s or so of the RTX 3060. Ask questions or receive news about about mining, hardware, software, profitability, and other related items. To get 100t/s on q8 you would need to have 1. cpp still has a CPU backend, so you need at least a decent CPU or it'll bottleneck. Or check it out in the app stores   Rtx 3060's PL 80% or 135w Cclock +200 or 2050 Mclock +1300 or 8600 Fan 100 Alph=495 mhs Eth=26. Please do NOT message Then adding the nvlink to the cost. I’m using Nicehash Trex miner Daggerhashimoto. For 5-bit itself, it will have 2 5 or about 32 context choice for what it will guess next context so it's rich enough. Please use our Discord server instead of supporting a company that acts against its users and unpaid moderators. I. Most experienced miners mine ergo and RVN istead of ETH because of better returns. About 440-450 E, and absolutely stable. Super easy to setup. You will get a decent 45-46 MH/s with t-rex, but profits a day are like maybe $3 (depends on ETH prices). I'd like to see how 2x12 GB 3060 compares to a P40 and how well it scales after that. 8sec/token Subreddit to discuss about Llama, the large language model created by Meta AI. Reply reply BlackberryConstant80 • My 1660 super hashrate stock is 25mh/s I find the I have added multi GPU support for llama. 2. 89 years) EVGA RTX 3060 Ti + Razer Core X My Zotac RTX 3060 Twin Edge OC works beautifully at about 48MH/s but only if plugged into the PCIE x16 slot and if a display is connected. I also don’t see the logic in buying 2 3060ti’s to save money when you can scoop up a 3080 or even a 4070 for less than the cost of 2 3060ti’s. Top. The price is quite It mostly depends on your ram bandwith, with dual channel ddr4 you should have around 3. ccp codeset (https://github. With mining machines I'm not to concerned about security as I don't have any Personal info on them. I'm now mining just for fun ETH on hiveos, but the hashrate is (of course) ridiculously low (22 mh/s There are no great 33/34B models currently compared to a low bpw 70B model. 15, that's 12 USD so it's $198 revenue per month. 30B Q6 (30MB) with 3 x 3060 or 2 x 4060Ti (purchase cost +250$) 2 hours/day * 50 days/year = 4. 5 - 39. r/radeon. This will be about 4-5 tokens per second versus 2-3 if you use GGUF. 05 driver. Until then, please utilize the resources in the MINING WIKI for additional useful guides and information. Models in GGUF format can be used with up to 8-bit (Q8) quantization, allowing you to allocate all the layers to the GPU. I've got a Asus ROG Strix G17 G713QM laptop with a high-power RTX 3060 in it. The Q6 should fit into your VRAM. 25 BPW is 30 t/s. 59 RTX 3080 - $5. Or check it out in the app stores   Buy an RTX 3060 12GB and combine it with my 3060 Ti to make it 20GB. I read the the 50xx cards will come at next year so then it will be a good time to add a second 4090. 1st Dell G15: 48. Shortly after, I was told of LHR cards and mining nerfs. 63 MH - ETH270. The 3090 has 3x the cuda cores and they’re 2 generations newer, and has over twice the memory bandwidth. 5$ per day. just easier to get full hashrate with them than version 2 3060 cards that use the newer LHR tricks and the old 470 View community ranking In the Top 5% of largest communities on Reddit. I think i have same problem wizard-vicuna-13b and RTX 3060 12GB VRAM i get only 2 tokens/second, i am using old epyc 32 cores 2. More posts you may like r/buildmeapc. Motherboard is Asus Pro Art AM5. gguf on a RTX 3060 and RTX 4070 where I can load about 18 layers on GPU. 20C. The P40 is restricted to llama. Wt is taken from the socket. 8 MH/s using a 2 fanned msi 3060 ti, MSI GeForce RTX 3060 Ti 8GB VENTUS 2X OC. Or check it out in the app stores   Mining with RTX 3060 LHR . I would recommend starting yourself off with Dolphin Llama-2 7b. I'm planning to buy it but I'm still worried about Nvidia locking the hash rate for eth mining. I get the best Octopus results on TRex miner. 0GHz CPU. Comparing the difference, while impacted by silicon lottery, it seems locking the core clock is better than just adding to it with a + ###. Having 2 1080ti’s won’t make the compute twice as fast, it will just compute the data from the layers on each card. Saw those for around $220. This is our little Romanian corner of Reddit! Members Online. e. All popular coins (essential after the Merge) include DUAL mining with Eth + Kaspa and Alephium. 05 driver or using dummy HDMI, but is that method good enough? I have a feeling that this will be fixed by Nvidia soon enough Discussion of mining the cryptocurrency Ethereum. Sell my RTX 3060 Ti 8GB, add some funds, and acquire a RTX4060 Ti 16GB. If you could choose, EVGA is a safe bet. Unfortunately during my short test I noticed issues with Q3 model, which breaks the deal form me. I have 2 GPU's currently mining. no issues . Started mining on a Monster laptop with RTX 3060 . I'm not sure if they belong to the first (rev. I Jul 18, 2023 · I've now taken a different approach and instead of using the Llama-2 sample code, I switched to the llama. 3060 Ti vs 3070 - they're about the same performance wise for mining. I encountered a statement saying the 3060 needed an active display connected to it (or an HDMI Please gain at least 15 comment karma before trying again. Corupție în numele Domnului 2: Șpagă pentru parohie youtube upvotes Don’t know about the 3060 but evga has a waaay better cooling system in the 3090 model, when others work at around 100°c evga be at 80°c. Eth Mining on a laptop RTX 3060 under 60 degrees Celsius - The Quest here's the thing. A Pentium G4400 dual core, 8gb RAM, 12 PCI-E slot mobo, 1650w PSU, a 128gb SSD for system (Debian, Oobabooga, StableDiffusion), a 5tb HDD for models. New Coding Model from IBM (IBM Granite I just have a gaming rig that I want to use between mining and gaming when I’m back from college. Mining with RTX 3060 12gb . r/LocalLLaMA. I reach 49,5 mh/s on Trex mining ETH on Ethermine Europe. 85 BPW w/Exllamav2 using a 6x3090 rig with 5 cards on 1x pcie speeds and 1 card 8x. For GPU-based inference, 16 GB of RAM is generally sufficient for most use cases, allowing the entire model to be held in memory without resorting to disk swapping. Also I run a 12 gb 3060 so vram with a single 4090 is kind of managed. CPU is AMD Ryzen 9 3900 12-Core Get the Reddit app Scan this QR code to download the app now. Or check it out in the app stores Best RTX 3060 TI LHR OC for kawpow mining? NHM Please share your overclock :)! Wanting to get as good hashrate as possible Getting good hashrates. Have ran at 50mh with 100% accepted shares for 2 days now. 3060 was the budget I ended up with an XC card, which is a 2-fan, half-size card with one 8-pin power connection. Of course, I am new to mining, so I have so much to learn. The remainder of my cards are 3060ti FTW. Getting 49 Mhs on both . 3060 TI are pretty good to mine with, they don't get very hot (mid-50s) and are quite efficient power-wise (about 350 kH/W). 87 votes, 66 comments. I use seperate pc and using their primary 16 slot. I have an extra RTX 3060 to mine but no available pcie slots. Here is a link from a provider that has more than 10 pieces available: Test Bench Specs: AMD Ryzen 5900X, Asrock X570 Taichi Razer, Corsair H150i Pro RGB AIO, G. Those 13B with 5-bit, KM or KS, will have good performance with enough space for context length. 5-4. - RTX 3060 Ti Mining Performance T-Rex Miner - Octopus - Conflux. We all knew the RTX 3050 was going to have LHR enabled, but here is the data I gathered so far from my colleague Dizzy Mining Update 7/15/2021: After answering a question regarding TGP of the RTX 3060 below, I further dug up that the boost power rating is 125 W for the RTX 3060, found under NVIDIA Control Panel -> System Information. What would be a good setup for the local Llama2: I have: 10 x RTX 3060 12 GB 4 X RTX 3080 10 GB 8 X RTX 3070TI 8 GB I know that it would be probably better if i could sell those GPUs and to buy 2 X RTX 3090 but I really want to keep them because it's too much hassle. rtx 3060 ti zotac twin edge lhr mining overclock settings Discussion I'm getting between 39. But in There isn't much quality difference between Q6k and Q8 but Q4KM is ~6% degraded. Or check it out in the app stores   I can run mixtral-8x7b-instruct-v0. I get 45-43 MH on Octopus with the one I also use for daily media. In case you haven't seen it: There is a fork at https://github. Whenever I m trying to install it's saying the "Nvidia graphics driver is not compatible with this version of windows. I currently get 48-49 MH/s with the pc freezing every few hours. . cpp llama-2-70b-chat converted to fp16 (no quantisation) works with Feb 22, 2024 · For those looking to run large language models like Llama-2 and Mistral, on a Oct 14, 2024 · MLC-LLM is a fast backend for AMD GPUs. Question: Which is correct to say: “the yolk of the egg are white” or “the yolk of the egg is white?” MSI Ventus GeForce RTX 3060 Ti 8GB (DUAL FAN) - $304. How much that 6% hurts depends on your task, for code it could be the difference between an answer that works and one that doesn't but for an assistant chat it doesn't matter nearly as much if it picks a different word somewhere. 80 at the top of the profitability. 00009638 bitcoin per day. advice for you don’t get into mining now difficulty is rising and price going down not to speak about eth Asics coming to flood the market I really doubt that you payoff a 2k$ gpu from now Because 70B 2. Or check it out in the app stores like 3060. 17 $/year (purchase repaid in 157. I can’t seem to find the correct settings for the MSI afterburner. 6" 165Hz QHD, GeForce RTX 3060, AMD Ryzen 9 5900HS, 16GB DDR4, 512GB PCIe NVMe SSD, Wi-Fi 6, Windows 10, Eclipse Gray, GA503QM-BS94Q upvotes · comments The $329 RTX 3060 is about 30% slower than the $399 RTX 3060 Ti, and about 25% faster than the Turing GeForce RTX 2060 which launched originally at $349. 99 €, shipped for 5€ on a famous French web reseller. Total training time in seconds (same batch size): 3090: 468 s 4060_ti: 915 s The actual amount of seconds here isn't too important, the primary thing is Subreddit to discuss about Llama, the large language model created by Meta AI. Normal ETH clocks, no Core added Average Hashrates: RTX 3060 32. Generation So it happened, that now I have two GPUs RTX 3090 and RTX 3060 (12Gb version). Now on the note of ETH going away. However the ability to run larger models and the recent developments to GGUF make it worth it IMO. Members Online. Or check it out in the app stores   But llama 30b in 4bit I get about 0. Or check it out in the app stores I made a video to show my revised method of doing the fan glitch on the RTX 3060. The rest on CPU where I have an I9-10900X and 160GB ram a fully reproducible open source LLM matching Llama 2 70b RAM and Memory Bandwidth. 3060 Ti is preferred since it's cheaper. However, I'd like to share that there are free alternatives available for you to experiment with before investing your hard-earned money. I'm in Australia and I haven't been able to find anything in stock for months. How about RVN (KawPow)? 3. I've read about the throttle down on the hashrate by NVIDIA, wondering if this will affect the ASUS 3060 on a Linux (HiveOS). cpp because of fp16 computations, whereas the 3060 isn't. 05 driver, a quartet of RTX 3060 cards, and a cheap system based upon an Intel Pentium G3220 with 700W PSU the user fully enabled with 'mining rig' by popping an HDMI dummy plug into each discrete 11 votes, 12 comments. I‘m working on a REST API for llama 2 70b uncensored—maybe you‘ll not need to Get the Reddit app Scan this QR code to download the app now. In Local LLama, I think you can run similar speed with RTX 3090s. Mine your favorite non-mineable crypto assets! now I'm mining with the rtx I'm getting about 25 MH/S. I bought the 3060 at msrp and just thought I’d either sell it or mine with it so I’m trying to see the best way to mine with it. 5 per to cudo miner. cuda. On my mining rig I have a 3060, 2x 3070, 2x 3080 with 2x deepcool 850W hooked on a msi z390 a pro. lol/3090ti. Temps at 52 celcius and wattage at 118 With 16 GB, it is larger than an RTX 3060 at about the same price. 8 Mhs 0 core / 0 mem TDP - 100% 240 Watt Use Reddit's search feature too, because odds are your question has already been asked before Get the Reddit app Scan this QR code to download the app now. g. I loaded the model on just the 1x cards and spread it out across them (0,15,15,15,15,15) and get 6-8 t/s at 8k context. maximimum power limit of 3060 gigabyte eagle is 212w & msi Zano Progpow overclocking RTX 3060 (my results) Mining PROGPOW - 3060 (135W) with 80% power limit, +200 core and +850 mem = 21 MH Not a lot of info on people mining this coin it seems :( Im sure eventually it will pick up in here just thought i would post to get things moving in this sub reddit :) ASUS ROG Zephyrus G15 Ultra Slim Gaming Laptop, 15. A forum user shared images and details of a surprisingly simple way to set up a 4-way RTX 3060 system for mining ETH. Get the Reddit app Scan this QR code to download the app now. 1) version is compatible with the Nvidia driver 470. Or check it out in the app stores     TOPICS Subreddit to discuss about Llama, the large language model created by Meta AI. Please use our Discord server instead of supporting a Get the Reddit app Scan this QR code to download the app now. Or check it out in the app stores Mining with Asus TUF Dash F15 RTX 3060 85W (cclock +55 memclock -305) Share Sort by: Best. I'm mining on a gaming machine I built ~february 2020 that I've barely gamed on since I bought it. Log In / Sign Up; Advertise on Reddit; Shop Collectible Avatars; Get the Reddit app Scan this QR code to download the app now They listed 120 GB/s unified memory bandwidth, which is 1/3 of a RTX 3060's peak 360GB/s. . vram build-up for prompt processing may only let you go to 8k on 12gb, but maybe the -lv (but make sure they are powers of 2). With cool airflow its more like 62-64C Reply reply Same_Detective_2648 • 65-70% pl -502 core +1175 mem 70% fan p0 state 49. New comments cannot be posted and votes cannot be cast. 10 if you don't pay for electricity. 1: Galax GeForce RTX 3060 12 GB GDDR6 (LHR - 1 Click OC) Galax GeForce RTX 3060 12 GB GDDR6 (LHR - 1 Click OC) 2 hi bro i have 2 rtx 3070 laptop mining for 15 days not stop and order more 5x that comes tomorrow loool i dont give a damm if people dont like laptop in my house its best solution works 24/7 spends half of energy and in portugal energy its expensive 2 laptops are spending 280 watts only that is 25€ light / month. 4bpw here. 10 per Kw/h, or $1. I've been messing around with 13B on my CPU with some nice but very slow results. Or check it out in the app stores   I recently bought a RTX 3060 card from EVGA. I recommend you give the latest Dolphin 2. yes, there are ways to unlock the hash rate like using 470. Accounts must be at least 21 days old for posting privilege in r/gpumining. 30B Q4 (20MB) with 2 x 3060 or 2 x 4060Ti (purchase cost +500$) 2 hours/day * 50 days/year = 3. Or check it out in the app stores RTX 3060 mobile 38MH 70W (pc limit) PC defined --- --- 6600 Share Add a Comment Mining Rig Setup Help: Can I run (6) RTX 3060 on ASROCK H110 PRO BTC + on GPU Risers Get the Reddit app Scan this QR code to download the app now. 05 driver, and my Mh/s doubled to 40. I got 2 cards, when youre using the 3060 for general media use while its mining, with a +200mhz core clock, +1500 memory clock overclock on MSI and a power limit of 76 (uses 129w then). S. You Unlucky but its the game, i have 1 on 6 3060 ti Hynix that crash around 1400 too. Rtx 3060 ti 28 mhs and 53 octo, gtx 1080 ti 22 kawpow for example Reply reply More replies Hello guys, recently I got 3060Ti, full name is ZOTAC GAMING GeForce RTX 3060 Ti Twin Edge nonOC(maybe manufacturer matters idk), I wanna try some mining for satisfy my interest in this sphere and if it would be profitable maybe I will end up build mining rig, also I am pretty new to mining and don't know much things about it. I wanted to test the difference between the two. Only 30XX series has NVlink, that apparently image generation can't use multiple GPUs, text-generation supposedly allows 2 GPUs to be used simultaneously, whether you can mix and match Nvidia/AMD, and so on. RTX 3060 12GB scaling only on core voltage - poor quality silicon? Hardware Hello, I bought an ASUS TUF 3060 12GB to experiment with and found much worse performance at low voltages I did an experiment with Goliath 120B EXL2 4. So roughly $8. g 4x 3060 Vs 2 x p40 My current GPU is a 4080 and no space to add a second GPU so this is a separate box for experiments. Your submission was automatically removed because your account is too new. Minus Electric at $0. It allows to run Llama 2 70B on 8 x Raspberry Pi 4B 4. It's not double profits by any means, just two different revenue streams. The 13b edition should be out within two weeks. System is stable never crash zero stales and 0 rejected shares. They are both installed in the x16 slots with the 3060 in the higher slot. Currently running Ubuntu testing LLM on the CPU to see just how bad it is. It could easily be headless as long as the X99 doesn't protest. I have a 3060 12GB, and it's fine. The RX 6600 XT is less expensive than the RTX 3060 TI in my country but the RTX I am getting 59. 1 MSI GF65 sitting flat on its belly with the backplate off, all electronic naked with a fan pointed at the gpu. Reddit is dying due to Subreddit to discuss about Llama, the large language model created by Meta AI. For the RTX 3060 (12GB), you can utilize any GPTQ 7B model. In my case, it will be more beneficial if I use the 23B model via GPTQ. The 3600 should probably be good enough for one P40, although I run mine with an i7-12700k so I can't say for sure, the 3600 is worse than that. I already ordered two x16 PCIe riser cables because my mobo has two x16 slots so I can at least (potentially) use two 3060 for mining. Or check it out in the app stores   Llama 3 70B EXL2 2. Or check it out in the app stores   I live in France, and i just ordered an GEFORCE RTX 3060 GAMING X 12G @ 629. I just upgraded my GPU to an RTX 3060 with 12GB thinking it would be enough to run this model (I recall having heard someone mention using a similar GPU for 30B), but now that I Get the Reddit app Scan this QR code to download the app now. 18 It is pretty easy to set up. Iam mining since 2 months with 3 MSI laptops. The retailer told me it wasn't a LHR, but in fact it is. Where are you getting a 3060 12gb for $170? Reply reply Hehe, it still feels the same even with a RTX 3060. Edit: forgot to mention the main reason, you can fit the entire 2. Key Takeaways: GPU is crucial: A high Use Reddit's search feature too, because odds are your question has already been asked before. mixtral 8x7b in 8 bit mode, or llama 70b in 4 bit mode) run faster on a RTX View community ranking In the Top 1% of largest communities on Reddit. Profit per day per card: RTX 3060 - $2. 00 a day on less profitable Algos, all the way up to $1. Greedy_Sir_477 • I run 2 3060 non LHr variant . E. I get 47 MH on the card thats only mining. Or check it out in the app stores Hi guys, I needed some help. Llama-2-70B-GPTQ and ExLlama. 2 t/s llama 7b I'm getting about 5 t/s llama 13b with a lora in 8bit is about 1-2t/s Would upgrading from a I have a bunch of crypto mining equipment I picked up when mining Etherium was dying awhile back. 90 RTX 3070 - $3. New comments cannot be posted. Once downloaded close any overclocking Currently, at the time of testing the RTX 3060 Ti will make you anywhere from $1. 4bpw 70B model on a single 3090 and run at full GPU-accelerated speeds. Use Reddit's search feature too, because odds are your question has already been asked before. Some articles on the internet say the 12GB 2060 is way better for mining than the 3060, so maybe it is better for machine learning as well. I am mining with 5 3060 on one board bro Reply reply More replies. priced like 2 3090s and won't even give you the 4 gigs. Figured I might as well get some use out of it. So I Get the Reddit app Scan this QR code to download the app now. -502, +1350, Power Limit at 70%, Fan speed 60% (Set up using MSI Afterburner). , TheBloke/Llama-2-7B-chat-GPTQ - on a system with a single NVIDIA GPU? It would be great to see some example code in Python on how to do it, if it is feasible at all. 8 on llama 2 13b q8. Ryzen 1200 RTX 3060 12GB Could I just slap an RTX 3060 12GB on this for Llama and Stable Diffusion? Is GPU all that matters or will my CPU/ram bottleneck it? Ryzen 5 3600 + RTX 3060 for CS 2. 3G, 20C/40T, 10. Also, I'm constantly getting these GPU stats per cudo miner: I started mining today in nicehash on my RTX 3060 but I am unable to install the 470. Q4_K_M. bat file before the miner command. Temps are around 56-61C. 63 years) EVGA RTX 3060 Ti + Razer Core X Model: We will be using the meta-llama/Llama-2-7b-hf, which is the smallest Llama 2 model. Temps at 52 celcius and wattage at 118 Now to test training I used them both to finetune llama 2 using a small dataset for 1 epoch, Qlora at 4bit precision. Update 7/16/2021: Increased my hashing rate just a tiny bit. 5 mhs With 3x 3070 and 3x 3060 mining eth in a pool and ALPH solo I averaged about $5. Matrix multiplications, which take up most of the runtime are split across all available GPUs by default. Keep in mind that the increased compute between a 1080ti and 3090 is massive. Last first month i did 240usd and thats with like the first 2 weeks of me tingkering (played with pool mining for 1 day), and not getting 24/7 mining. Reply reply Active_Substance_196 This can be resolved 1 of 2 ways You add the full folder/file path in the . I want to buy a RTX 3060 and have found 2 offers. But the text completion is just too inconstant compared to 70B models and unfortunately 70B Q5 is too slow for a real time agent on DDR4 ram and a Ryzen 5 3600 How much does a 3060 make on Salad? There's a ton of variables that could change this (just check out this article for some more information on how mining works at Salad), but a good guesstimate would be ~$3. RTX 3060 Ti, 50 Game Benchmark r/nvidia A place for everything NVIDIA, come talk about news, drivers, rumors, GPUs, the industry, show-off your build and more. Reply reply More replies More replies. Discussion of mining the cryptocurrency Ethereum. 5. r/GamingLaptops. OutOfMemoryError: CUDA out of memory. Thanks, Dane Get the Reddit app Scan this QR code to download the app now. You turn down the security in windows to stop asking. 4GT/s, 30M Cache, Turbo, HT (150W) DDR4-2666 OR other recommendations? Get the Reddit app Scan this QR code to download the app now. 22 RTX 3060 TI - $2. University Lab's First Get the Reddit app Scan this QR code to download the app now. For those looking to run large language models like Llama-2 and Mistral, on a PC built with RTX 3060 (12GB VRAM), here’s a concise guide on what model you can run. On a whim I decided to try my hand at mining. So far from what Ive noticed is that I would get a beautiful 49 mh/s rate for a minute or two then it just drops to 29-38w mh/s. The winner is clear and it's not a fair test, but I think that's a valid question for many, who want to enter the LLM world Hey guys! I have a Palit RTX 3060 OC edition with 1300 Watts of Power supply, but after few hours the screen freezes and the mining stops. Settings are mainly for HiveOS and RaveOS. 00 MiB (GPU 0; 10. many people recommended 12gb vram. I have nicehash installed on my pc (it feels better than quickminer and a lot more user friendly) My 3060 Ti (LHR) is only getting around 22 MH/s on Trex KAWPOW My 2060 super is getting 41 MH/s on Excavator DaggerHashimoto Overall I make about 0. cpp or other similar models, you may feel tempted to purchase a used 3090, 4090, or an Apple M2 to run these models. New [RTX 3060] $2248 + My AMD 7950X3D ( 16 core 32 threads), 64GB DDR5, Single RTX 4090 on 13B Xwin GGUF q8 can run at 45T/S. 65bpw exl2 quants fit in 24GB VRAM. Is there a calculator or website to calculate the amount of performance I would get? I found a cheap GPU, the MSI RTX 3060 Ventus 2X OC it's an old mining rig. Or check it out in the app stores   My RTX 3060 mines at 47-49 MH/s at 99 Watts. Need information regarding PCIe slot requirements for RTX 3060 mining RVN Mining So I've been doing research on the RTX 3060 as it is the most reasonable card I can buy where I live and actually bought two of them in a limited sale for about 1500 USD. 00/day (assuming you Get the Reddit app Scan this QR code to download the app now. Specifically, I have a couple MSI 360-F Pro motherboard’s that supports 18 GPU’s and everything needed to run 18x PNY A2000 RTX 6GB. GPU: RTX 3060 (~900) GPU 2: RTX 3060 (~900) GPU 3: GTX 1650 Super (used) Misc: HDMI Dummies ($12) Are there any obvious problems with this setup? Are there any ways to tweak it? I probably also need PCI-e risers. Downloaded cudo miner. I should note that after rebooting the computer, the speed results change randomly. Please note that ALPH is not affected at all by LHR, which makes it very profitable on LHR cards. Two RTX 3060 Tis will have only 16GB of VRAM in total and splitting a model between two GPUs will use more VRAM then if you loaded the whole Reddit iOS Reddit Android Reddit Premium Copy link Embed Go to EtherMining r/EtherMining • by beerdude26. Things like cutting off mid-sentence or start talking to itself etc. Best. Or check it out in the app stores     TOPICS RTX 3060 ERGO Mining OC Settings? I have a rig of 6 RTX 3060 (Palit) and im looking for a good overclock, its tricky because sometimes the bios takes the ERG algorithm as the ETH algorithm and reduces 50%. 05 Beta GameReady driver I am using phoenix miner for 2 weeks now. - RTX 3060 12GB for budget friendly Hi, just thought I'd share my OC settings on an Asus RTX 3060 TUF GAMING OC 12G GDDR6 GPU in my gaming PC that I use for mining in spare time. 43C, Room Temp. Please do NOT message the moderators in regards to this. Build a platform around the GPU(s) By platform I mean motherboard+CPU+RAM as these are pretty tightly I'm looking for a GPU and I found an RTX 3060 at a good price. Or check it out in the app stores   Is it possible to fine-tune GPTQ model - e. Even if the difference is only 2/3 mg/s the 3060ti is still more efficient. Note: Reddit is dying due to terrible leadership from CEO /u/spez. Or check it out in the app stores     TOPICS My question is would I benefit more from selling my RTX 3060 and getting a RTX 3080 or buying another RTX 3060 (same as mine) and having 2 in my rig. The computer will be a PowerEdge T550 from Dell with 258 GB RAM, Intel® Xeon® Silver 4316 2. However, for larger models, 32 GB or more of RAM can provide a Hi everyone, I am planning to build a GPU server with a budget of $25-30k and I would like your help in choosing a suitable GPU for my setup. Or check it out in the app stores Subreddit to discuss about Llama, the large language model created by Meta AI. 23 votes, 18 comments. This is about the same performance as an RTX 3060. With a RTX 3060 (non-Ti), CFX (Octopus) mining nets you 5$ per day. Getting around 80 MH/s I have a ASUS ROG STRIX B450-F Motherboard- SOCKET AM4 which has 3 x16 slots and 3x1 slots. Our team spent a lot of hours testing and proving the best ones. My Zotac RTX 3060 Twin I got: torch. prices range from 370$ The infographic could use details on multi-GPU arrangements. Mar 3, 2023 · RTX 3090 FE 24GB (with 2 monitors connected) Ryzen 7 3700X; 32GB RAM; Llama 13B on a single RTX 3090. based on producing a rig that will blister Apex Legends (running at 240hz not all gpu have equal capabilities in terms of tgp (total graphics power) aka power limit (which can can have 2 different values: stock power limit and max power limits). wattage being at 120w. I have an RTX 3060. Reddit is dying due to terrible leadership from CEO /u/spez. 99 w/ code VGAEXCMSET448 /r/StableDiffusion is back open after the protest of Reddit killing open API access Discussion of mining the cryptocurrency Ethereum. a rig of 6 RTX However, data and information are what I like, so below is the Mining performance of the 3080 and 3060 Ti when mining Octopus - Conflux. 50 in ETH and 2 ALPH blocks a day. 75 $/year (purchase repaid in 52. Skill TridentZ RGB, EVGA XC RTX 3060, Corsair MP600 1TB Nvme SSD, Seasonic 1200 Watt PSU, Corsair Obsidian 500D Case Get the Reddit app Scan this QR code to download the app now. Ryzen 5 3600 + RTX 3060 for CS 2 comment. 1 models, let’s summarize the key points and provide a step-by-step guide to building your own Llama rig. E, you only need crypto to stay afloat for 2 months to make back your initial investment, at MSRP, afterwards you can dump the GPUs on the secondhand market for near MSRP prices. Or check it out in the app stores Home RTX 3060 MINING ETH AT FULL SPEED Hardware Locked post. and bottom line laptop have 2 years garantee if burn i send to I have a 13600K, lots of ddr5 ram and a 3060 with 12gb. I've narrowed it down to two options, the RTX 3060 TI and the RX 6600 XT. 5 mh 45-49c Get the Reddit app Scan this QR code to download the app now. It is a wholly uncensored model, and is pretty modern, so it should do a decent job. RTX 3060 12 GB for stable diffusion, BERT and LLama /r/StableDiffusion is back open after the protest Get the Reddit app Scan this QR code to download the app now. The CPU mining isn't much, but I happen to really like Monero anyways. PNY RTX 3060 still mining at 21 MH/s despite using Hdmi dummy, 16x slot & 470. Or check it out in the app stores     TOPICS I was able to run the 23B model on a 3060 graphics card. Need information regarding PCIe slot requirements for RTX 3060 mining RVN To those who are starting out on the llama model with llama. Top 1% Rank by size . 2) version, because as far as I know only the first (rev. I'm not overclocking. r/buildmeapc Upgrade 3060 to RTX 4070ti or 4080 comments. Please do NOT message I re-installed the 1660 super and the RTX 3060 and the same, RTX 3060 runs at x8 and 1660 super run at x4. 50 a day. tckb ptkxu wdmnb ogxgm rru ylbap gcz wbfu hdbhut ugbcb