path application

shuttingdowntheblog-deactivated  asked:

Hi, I was just wondering if you had any tips for novice kitchen witches? I've only just started this week and aren't quite sure what I really need to do/have. Any advice you could offer would be greatly appreciated! Thank you so much in advance

Hello, and sorry for a belated response, I’ve been traveling. (I’m going to start a lot of my replies like this in the near future…)

Welcome to the kitchen path! I can definitely understand how you can at the same time feel the spiritual need to start it, and a practical uncertainty of what to actually do. It’s totally normal and also quite exciting.

Whenever someone asks me “where to start” (and it happens pretty often, I’ve got to put together some sort of FAQ one of those days!), I always advise this:

Start by working out what is it that drew you to kitchen witchcraft in the first place. Was it the need to protect and care for yourself, your house, your family? Or perhaps a wish for a path with practical application? Or maybe just a really deep love for cooking?
What is it that you want to achieve through it - find peace, feel like a true mistress of the house, start a herb garden? The possibilities are endless, so it’s a good idea to know what is it you’re hoping to find by following this path.

Knowing this will tell you what to do, and how. For example, a person who wants to practice kitchen witchcraft as a way to care and protect their family would start by studying healthy food recipes, protective herbs and ways to incorporate those to their daily meals and so on.

Kitchen witchcraft is, to use the simplest “definition” which I find the most helpful, an incorporation of spiritual, magical, symbolic or religious rites into everyday chores. So, whatever your personal motives, a good way to start is to get yourself used to thinking about these chores in a new way, and to performing those chores - like cooking, or gardening, or cleaning - while being conscious of their spiritual meaning to you as a kitchen witch.

Or, to put it even more plainly, the next time you mop your floors, think of how this makes your house not only more clean, but also more secure, more healthy, more safe, more beautiful, and more yours.

Schnee Hereditary Semblance – Glyphs

The most basic ability of the Schnee Semblance is the creation of Glyphs, which in turn have two basic functions: Push and Pull.

Pushing-type Glyphs can be used as catapults. By laying one down on the ground her feet, a Schnee can leap higher into the air, or throw herself forward along the ground at greater speed.

Laying a path of multiple such Glyphs along the ground naturally extends this effect, though it can also telegraph the course she intends to take. It is possible use paths of pushing-type Glyphs to assist one’s ability to run alongside or even straight up steep surfaces.

By creating a pushing-type Glyph in midair, the Schnee may create a platform from which to jump without needing to return to the ground. Multiple platforms enable her to make as many additional midair leaps as she creates Glyphs, though she must be cautious against enemies fast enough to aim at the Glyph where she intends to go.

Midair pushing-type Glyphs can also be wielded as shields against projectiles, and walls that obstruct an enemy’s path. Presumably, these defensive applications can also be used to remotely protect one’s allies.

Alternatively, pushing-type Glyphs can be used to catapult enemies in the direction that best pleases the Schnee. Weiss Schnee was once observed to create a Glyph behind a target, before kicking him into the Glyph, which then proceeded to launch him out of its other side with far greater force.

Pulling-type Glyphs may be more difficult, which would only be natural if their basic function is to push.

By creating a pulling-type Glyph underneath her feet, a Schnee may anchor herself against forces which seek to push or pull her from that spot. By creating a series of anchoring Glyphs, she might forge her way forward against a mighty gale or slowly retreat from a strong vacuum. It would even be possible to create paths along ceilings to walk upside down; walking or running along walls would actually be more difficult, as gravity pulls her off-center.

Creating pulling-type Glyphs under the feet of others would allow a Schnee to grant these functions unto an ally, or else to root her enemy to the ground or bind him to a wall, hindering or even halting his ability to move. Using surfaces such as floors and walls might not even be strictly necessary, as Glyphs can be created in midair.

Glyphs are sometimes colored black, but this has no particular rhyme or reason. Weiss has been seen to use both white and black Glyphs to propel her allies. The black Glyph she used to fire Ruby in “Players and Pieces” seems the same as the one she used against Bolin in “Round One”, but Ruby was fired from the same side as she made contact with the Glyph, and Bolin was fired out of the other side. Ruby’s Glyph also turned red, though that may have been because she used her own Semblance in conjunction. Black Glyphs also don’t simply repel, as Weiss used them to anchor herself against Flynt. Blue-black Glyphs were used both as a wall against Professor Port’s Boarbatusk and as a midair launching platform to stab it afterwards.

Time Dilation / Summoning / Special Snowflakes

back to my Semblance index 

back to my sub-index on the Schnee Family

Yahoo Cloud Object Store - Object Storage at Exabyte Scale

Yahoo stores more than 250 Billion objects and half an exabyte of perpetually durable user content such as photos, videos, email, and blog posts. Object storage at Yahoo is growing at 20-25% annually. The growth is primarily driven by mobile, images, video, and user growth. Yahoo is betting on software defined storage to scale storage cost effectively along with the durability and latency guarantees.

Object Storage Landscape at Yahoo

What is “object storage”? Images and photos in Flickr, Videos, and documents, spreadsheets, and presentations exchanged as Mail attachments are classic examples of “objects.” The typical quality of this class of data is “write-once-read-many.” Traditionally, Yahoo has used storage appliances for object storage. As Yahoo is increasingly becoming the guide for digital information to our users, object storage need in Yahoo is growing rapidly. Additionally, application characteristics differ in access patterns, durability and latency needs, and cost targets. To support growth cost effectively and meet the varying application needs, object storage in Yahoo requires different tradeoffs. We need the flexibility offered by software defined storage to deliver these tradeoffs.

Why Software Defined Storage?

Key benefits of software defined storage are:

  • Cost-performance tradeoff: Allow applications to choose performance and cost tradeoffs with different hardware and durability configurations using the same software stack.
  • Flexible interfaces: Ability to choose industry standard API, embed client libraries in applications, or even use proprietary API where required. Industry standard APIs allow seamless migration of applications from public to Yahoo private cloud.
  • Different storage abstractions: Leverage the same storage software stack across Object, Block, and File abstractions, thus reducing  R&D and operational costs.

Cloud Object Store (COS) is Yahoo’s commodity hardware based software defined storage solution. In partnership with Flickr we have completed a multi-petabyte initial deployment of COS. And, in 2015, we plan to offer COS as a multi-tenant hosted service, and grow COS by ten-fold to support Flickr, Yahoo Mail and Tumblr. That is 100s of petabytes of storage to be supported on COS.

Under the Hood

COS is deployed using Ceph storage technology. We evaluated open-source solutions such as Swift and Ceph, as well as commercial solutions.  We chose Ceph because it enables consolidation of storage tiers for Object, Block, and File with inherent architectural support. Also, being an open-source product, Ceph provides the flexibility needed to customize for Yahoo needs.

Deployment Architecture

COS deployment consists of modular Ceph clusters with each Ceph cluster treated as a pod. Multiple such Ceph clusters deployed simultaneously form a COS “supercluster” as shown in Fig 1. Objects are uniformly distributed across all the clusters in a supercluster. We use a proprietary hashing mechanism to distribute objects. The hashing algorithm is implemented in a client library embedded in the applications.

After several trial runs and software tweaks, current deployment of each Ceph cluster is approximately 3 petabytes of raw capacity to provide predictable latency both during normal operations and recovery from hardware failures. Since each cluster consists of tens of commodity servers and hundreds of disks, it is highly likely that components will fail frequently. High disk and network activity occurs during recovery due to rebalancing of objects, which in turn increases object read latency during this phase. Capping the size of each cluster allows us to limit the resource usage during recovery phases in order to adhere to latency SLAs.

Yahoo users expect their images, videos and mail attachments to be perpetually stored, and made available instantaneously from anywhere around the world. This requires high data “durability” guarantees. Durability is typically achieved in storage systems either via redundancy or encoding. Redundancy can be provided through extra copies of data or replicas. On the other hand, encoding can be provided via traditional mechanisms like simple parity, or more sophisticated mechanisms like erasure coding. Erasure coding breaks down an object into fragments and stores them across multiple disks with a few redundant pieces to tolerate multiple failures.

The usable capacity of each cluster depends on the durability technique used. We currently employ erasure coding with each object broken down into eight data and three coding fragments. This mechanism, called 8/3 erasure coding, can tolerate up to three simultaneous server and/or disk failures with about 30% storage overhead for durability. This is much lower than the 200% overhead in case of replication.   

The two durability techniques offer different price points and latency characteristics. Replication offers lower latency but a higher cost, whereas erasure coding reduces cost (sometimes by up to 50%)  at a slightly higher latency. We can also deploy different storage media such as SSD, HDD and Shingled Magnetic Recording (SMR) drives to enable different service levels depending on the application.

Technically, it is possible to scale a COS supercluster by adding storage needs to increase the capacity of the component clusters. However, this will lead to rebalancing of data within the component clusters, thereby creating prolonged disk and network activity and impact latency SLA. To scale COS, our preferred approach is to add COS superclusters as needed similar to adding storage farms. This approach is consistent with our current appliance-based storage solution that applications are already familiar with.

Latency Optimizations

COS is in the serving path for many Yahoo applications and has to guarantee latency SLAs to ensure consistent high quality of user experience. We have implemented over 40 optimizations in Ceph to realize 50% improvement on average, and 70% improvement in 99.99% latency. Fig 2 depicts the latency chart before and after the optimizations under normal operations. The latencies in this chart are measured across objects of different sizes in the Flickr workload.

Some of the major optimizations are:

  • Redundant parallel reads with erasure coding: Currently, we have deployed 8/3 erasure coding scheme for durability. Increasing the parallel reads to 11 chunks, instead of the default 8 employed in Ceph, and reconstructing the object upon first 8 retrievals provided significant improvement in long tail read latency. This reduced average latency by approximately 40%.
  • Recovery Throttling: Upon disk and node failures, Ceph automatically initiates recovery to maintain high durability of objects. During recovery, storage nodes are busy leading to high read/write latency. We implemented tunable recovery throttle rate to mitigate this impact. This reduce average latency during recovery by approximately 60%.
  • Bucket Sharding: Amazon S3 API specification requires objects to be bucketized. Ceph implements bucket as an object hosted on a single storage node. At our scale, the storage node that hosts the bucket becomes a hotspot, which we mitigated by implementing sharded buckets that are spread across multiple nodes.

Future Development

So far, we have tuned COS to a large Yahoo use-case, namely Flickr. However, other Yahoo use cases require object storage with different workload patterns and different tradeoffs. To make COS a widely used platform at Yahoo, we are addressing several enhancements in near to mid term.

  • Scale: We have already deployed an initial multi-petabyte solution. In 2015, we plan to grow this 10-fold or more to accommodate other use cases  such as Mail, Video, Tumblr etc. along with Flickr growth.
  • Geo Replication for Business Continuity: Currently, geo replication is carried out the application level. Ceph supports Geo-replication. However, we have not tested this capability for the scale and latency that Yahoo needs. We plan to scale and deploy geo-replication in COS.
  • Optimize latency for small objects: Many use-cases such as serving thumbnails and serving during image search have small objects of the order of a few kilobytes. We need to tune COS for these use-cases.
  • Lifecycle management: One of the big advantages of Software Defined Storage is the hardware, software choices for cost and performance tradeoffs. Automatic classification of  objects into hot, warm, and cold objects will allow us to take advantage of that flexibility and provide differentiated services.

By Narayan P.P.S, Sambit Samal, Satheesh Nanniyur