Factbites
 Where results make sense
About us   |   Why use us?   |   Reviews   |   PR   |   Contact us  

Topic: Distributed memory


Related Topics

In the News (Thu 16 Feb 12)

  
  NewsForge | Shared vs. distributed memory in large Linux clusters
Distributed memory describes the model of the commodity cluster, which has a large number of nodes, each with its own processor(s), system disk, and networking.
Distributed memory machines are best suited to "coarse-grained" problems, where each node can compute its piece of the problem with less-frequent communication with adjacent nodes.
An example of a distributed memory architecture is the $5.2 million Terascale Project cluster at Virginia Tech.
www.newsforge.com /software/03/10/31/0732243.shtml?tid=2&tid=74&tid=82&tid=94   (1104 words)

  
  Distributed computing - Wikipedia, the free encyclopedia
Distributed computing is decentralised and parallel computing, using two or more computers communicating over a network to accomplish a common objective or task.
A heterogeneous distributed system is made up of different kinds of computers, possibly with vastly differing memory sizes, processing power and even basic underlying architecture.
Distributed computing differs from cluster computing in that computers in a distributed computing environment are typically not exclusively running "group" tasks, whereas clustered computers are usually much more tightly coupled.
en.wikipedia.org /wiki/Distributed_computing   (1811 words)

  
 Distributed shared memory - Wikipedia, the free encyclopedia
Distributed Shared Memory (DSM), in computer science, refers to a wide class of software and hardware implementations, in which each node of a cluster has access to a large shared memory in addition to each node's limited non-shared private memory.
Such systems are transparent to the developer; which means that the underlying distributed memory is completely hidden from the users.
Shared memory architecture may involve separating memory into shared parts distributed amongst nodes and main memory; or distributing all memory between nodes.
en.wikipedia.org /wiki/Distributed_shared_memory   (254 words)

  
 Distributed memory - Wikipedia, the free encyclopedia
Distributed memory is a concept used in parallel computing.
It means that in a multi-processor system each processor has its own memory.
The related term is Distributed shared memory, a model in which in addition to private memories of the nodes there exist large, conceptually shared memory (though in reality such memory may be physically distributed between many different nodes, hence the name).
en.wikipedia.org /wiki/Distributed_memory   (119 words)

  
 Memory (Stanford Encyclopedia of Philosophy)
Both semantic and episodic memories, whether linguistically expressed or not, usually aim at truth, and are together sometimes called ‘declarative memory’, in contrast to nondeclarative forms of memory, which don't seem to represent the world or the past in the same sense.
But to say that psychologists of memory have turned their research efforts to the study of suggestibility, misinformation, and distortion is not, of course, to say that accuracy in memory has suddenly been shown by science to be impossible or unlikely.
Engel (1999) and Schacter (1996) are reliable and well-written introductions to the psychology of memory in general: Tulving and Craik (2000) is a thorough handbook on the cognitive psychology and neuropsychology of memory.
plato.stanford.edu /entries/memory   (11291 words)

  
 Strategy for Introducing Distributed Memory Multiprocessing to CMISS — cmiss
Distributed memory multiprocessing has been implemented in CMISS previously for finite deformation mechanics to calculate element stiffness matrix calculations of different elements on potentially different processors.
With distributed memory multiprocessing, all data is by default local to the process, and so there is little risk of one processes's data begin corrupted by another process.
Distributed memory programming standards, however, do not provide such a mechanism, and so it will be necessary to determine a way for the code to behave differently when using and not using distributed memory multiprocessing.
www.cmiss.org /cm/wiki/StrategyForIntroducingDistributedMemoryMultiprocessingToCMISS   (3989 words)

  
 Distributed shared memory Summary
Prior to the development of modern virtual memory mediated exchanges between separated memory systems, program execution speeds and reliability were often hampered by the need for physical file swapping and the extensive fragmentation of programs.
Distributed Shared Memory (DSM), in computer science, refers to a wide class of software and hardware implementations, in which each node of a cluster has access to a large shared memory in addition to each node's limited non-shared private memory.
Shared memory architecture may involve separating memory into shared parts distributed amongst nodes and main memory; or distributing all memory between nodes.
www.bookrags.com /Distributed_shared_memory   (1024 words)

  
 Distributed Shared Memory   (Site not responding. Last check: 2007-10-19)
Distributed shared memory is a technique for making multicomputers easier to program by simulating shared memory on them.
What this means is that memory operations (reads and writes) no longer behave as we would intuitively expect them to behave.
Note that the memory system has no obligation to provide the proper values to processes that do not do the appropriate acquire (as in the case of P3).
www.cs.rutgers.edu /~pxk/rutgers/syllabus/dsm.html   (1476 words)

  
 Distributed Shared Memory Home Pages   (Site not responding. Last check: 2007-10-19)
Page-based distributed shared memory is similar to the virtual memory mechanism of an operating system except that the pages may exist across a network of machines (in a distributed operating system the virtual memory mechanism and page-based distributed shared memory may be one and the same).
An advantage of page-based distributed shared memory is that memory access is completely seamless, the user simply accesses the address of memory and the page is automatically swapped in.
Efficient distributed synchronization primitives are necessary at user level as well as at SVM level to implement (especially weaker) consistency models.
www.cs.utexas.edu /users/kistler/dsm/dsm_links.htm   (5710 words)

  
 Mach Microkernel Support for Distributed Memory Multiprocessors   (Site not responding. Last check: 2007-10-19)
An external pager allocates a port, distributes it to clients, and then listens on the port for page-in and page-out requests; clients then use the vm_map call to tell the kernel to allocate a region of memory in their address spaces backed by the external pager.
Finally, shared memory is provided by the Mach interface as a by-product of task creation; if the parent task has marked a region of its memory as inherit-shared, then its child task will share that region with its parent instead of receiving a copy.
The distributed kernel thus allows the entire distributed memory of a distributed memory multiprocessor to be managed as a single cache.
www.barrera.org /machdmmp/machdmmp.htm   (1846 words)

  
 Shared Memory Parallel Programming with Entry Consistency for Distributed Memory Multiprocessors   (Site not responding. Last check: 2007-10-19)
Distributed memory multiprocessing offers a cost-effective and scalable solution for a large class of scientific and numeric applications.
Unfortunately, the performance of current distributed memory programming environments suffers because the frequency of communication between processors can exceed that required to ensure a correctly functioning program.
Midway is a shared memory parallel programming system which addresses the problem of excessive communication in a distributed memory multiprocessor.
www.pitecan.com /bib/Bershad_CMUCS91170.html   (479 words)

  
 Sparse Distributed Memory as a tool for Conscious Cognitive Software Agents
SDM (Sparse Distributed Memory) is a content addressable, associative memory technique which relies on close memory items tending to be clustered together, with some abstraction and blurring of details.
Memory Capacity T is the size of the data set for which the critical distance is zero.
Each of the memories has an input and an output focus to prevent overwriting of input cues since the output from reading is usually different from the input.
www.msci.memphis.edu /~cmattie/Sparse_Distributed_Memory_as_a_tool_for_Conscious_Software_Agents/Sparse_Distributed_Memory_as_a_tool_for_Conscious_Software_Agents.html   (5789 words)

  
 Transactional Distributed Shared Memory
My thesis is that the combination of transactions and distributed shared memory is feasible and useful for a certain class of distributed application, especially those applications which have concurrent access to data that must not be corrupted, and need caching to provide adequate performance.
Distributed shared memory will not necessarily benefit all applications, however, since it may transfer more data than is needed by the application, and the cost of keeping the cached data consistent may be too large relative to the cost of the processing performed on the data.
Distributed shared memory automatically partitions the data among nodes to match the locality of reference, and migrates the data as references move.
www.cs.cmu.edu /People/abh/summary.html   (5281 words)

  
 Introduction to Programming Shared-Memory and Distributed-Memory Parallel Computers   (Site not responding. Last check: 2007-10-19)
Load balancing is the problem of distributing a task to a set of processors so that each processor has approximately the same amount of work to perform.
A data packet sent with MPI requires several pieces of information: the sending process, the receiving process, the starting address in memory of the data to be sent, the number of data items being sent, a message identifier, and the group of processes that can receive the message.
Distribute data to all processors in a group from all processes in the group.
www.acm.org /crossroads/xrds8-3/programming.html   (3676 words)

  
 Simulation of Shared Memory on a Distributed Memory Machine
Unfortunately, although the purely abstracted shared memory models give the designers of parallel algorithms the opportunity to focus in the matters of the parallelism itself when considering a specific problem, they are very difficult to implement on realistic architectures, at least to within the performance guarantee indicated by the analysis of the algorithm.
In a distributed memory communication environment in which the higher level routines and/or abstractions are built upon lower level message passing routines, the benefits of standardization are particularly apparent.
Some measures for the quality of a simulation, are the slowdown that it induces to the execution of a PRAM algorithm, the time-processor efficiency, the memory contention (that is, the number of requests that have to be served by a single Distributed Memory module in a simulated step) and the simplicity of the strategy.
students.ceid.upatras.gr /~kontog/SMS-Frame/fr_des.htm   (7162 words)

  
 Sparse Distributed Memory - in Perl!   (Site not responding. Last check: 2007-10-19)
Sparse Distributed Memory (SDM) is an idea that was developed by Pentti Kanerva in 1988.
If the vector in memory is close in "distance" (actually, Hamming distance) to the unknown vector, it is then put on the list of other vectors that were within tolerance.
After all the vectors in memory have been searched, a new vector is then created, which is more like the original image then the unknown vector was.
users.binary.net /thehaas/sdm   (396 words)

  
 Sparse Distributed Memory
Though it may not be an exact model of human memory, it shares enough characteristics to suggest that human memory works in a similar way.
Kanerva found that, when he ignored most of the points, the distributed nature of the space meant the model still had the same properties.
Verbatim copying and distribution of this entire article is permitted in any medium, provided this notice is preserved.
www.murrayc.com /learning/AI/sparsedistributedmemory.shtml   (807 words)

  
 Shared versus distributed memory   (Site not responding. Last check: 2007-10-19)
In a shared memory system, processors communicate by reading and writing messages to a globally known memory address.
In a distributed memory system, processors communicate by sending messages to each other.
The machine must usually ensure that all memory addresses are consistently seen by the processors.
www.cs.mu.oz.au /677/notes/node18.html   (389 words)

  
 Distributed Shared Memory in Forth
Distributed Shared Memory or DSM in these days of increasingly networked computers has been widely recognized as a simple construct upon which to build inexpensive parallel processing systems.
Tightly coupled machines use memory that is physically shared so that part or all of the memory available to a processor is also available to other processors.
The advantage of the tightly coupled design is that memory is physically shared so access may be very fast and in the example in Figure 3 all of the memory is available to each processor.
www.ultratechnology.com /4thdsm.html   (1471 words)

  
 Distributed memory   (Site not responding. Last check: 2007-10-19)
In distributed memory parallel programming, each processor has it's own memory, and only that processor can access that memory.
To access other parts of the memory than it's own, the processor has to communicate with the owning processor and transfer the needed information.
The running time is just about the same as for shared memory, but depending a bit on the communication time.
www.parallab.uib.no /projects/molecul/matrix/main/node8.html   (406 words)

  
 Distributed Shared-Memory Architectures
Distributed shared-memory machines need cache coherence for the same reasons that centralized shared-memory machines need it.
The distributed nature of the snooping protocol's data structure (which maintains the state of the cache blocks) does NOT scale well.
Deciding the order of accesses in a distributed memory system is much harder.
www.cs.umbc.edu /~plusquel/611/slides/chap8_3.html   (757 words)

  
 Morph: Networked Minds, Distributed Memory   (Site not responding. Last check: 2007-10-19)
Every day a little bit of living history dies as memories are lost with the passing of previous generations.
It was an interesting oral-history lesson as I watched these aging engineers stitch together their recollections of those early room-sized computers and the dawn of the 'mini' computer age in the 1960s.
This is the power of distributed memory linked by the ability not just to search for information but to search for, find and be connected to people, their stories and their memories.
www.mediacenterblog.org /2006/03/networked_minds_1   (782 words)

  
 Distributed Memory Machines   (Site not responding. Last check: 2007-10-19)
Parallel scaling of STREAM memory bandwidth is essentially perfect on distributed memory machines, so only single-node results are presented in Figure 6.
On investigation, it is found that this is because the memory system on the T3D can write significantly faster than it can read.
Details are presented in Appendix A. It is also interesting to note that the Cray T3D has much higher sustainable memory bandwidth values than any of the workstations, servers, or shared-memory systems employing the DEC 21064 processor, and it actually outperforms even the newer systems based on the DEC 21164 processor.
home.austin.rr.com /mccalpin/papers/bandwidth/node8.html   (220 words)

  
 Lecture 9: Distributed Memory
Virtual Memory = not all memory space need be physically present in main memory.
Any Read of a memory location x is affected by a previous Write of memory x by any process.
While strict is nearly impossible on a distributed system, sequential is possible but with a penalty the r + w >= transfer time between nodes.
www.cs.odu.edu /~wild/cs771/Fall96/lecture9.htm   (847 words)

  
 Distributed Shared Memory and Memory Objects
Distributed shared memories (DSM) allow processes to share memory objects even when they execute in environments such as workstation cluster where shared memory is not provided by the the hardware.
We have implemented Indigo, a user-level library which can be used to implement several types of distributed memory systems.
Such memory objects were constructed on top of the Indigo system that has been implemented by us.
www.cc.gatech.edu /systems/projects/COBS/apr_96/node7.html   (215 words)

  
 CTC VW: Distributed Memory Programming
That situation began to change significantly in the '70s with the advent of the first slow, narrow-bandwidth, and often-interrupted tele-communications networks connecting academic and research facilities in various locations across the country.
This presentation will provide you with the fundamentals of the central issues concerning distributed processing, progressing from an overview of hardware aspects, through an introduction to important software concerns, and ending with a discussion of significant issues in the design of distributed applications.
By the end of this presentation you can expect to have a good understanding of the important ideas, terms, concepts, and issues relevant to the field, and the hardware and software vehicles most often found implementing and supporting it.
www.tc.cornell.edu /Services/Education/Topics/Parallel/Distributed   (290 words)

  
 Top500.Org: Distributed-memory SIMD machines
Figure 3 might suggest that all processors in such systems are connected in a 2-D grid and indeed, the interconnection topology of this type of machines always includes the 2-D grid.
It is possible to exclude processors in the array from executing an instruction on certain logical conditions, but this means that for the time of this instruction these processors are idle (a direct consequence of the SIMD type operation) which immediately lowers the performance.
Another factor that may adversely affect the speed occurs when data required by processor i resides in the memory of processor j (in fact, as this occurs for all processors at the same time this effectively means that data will have to be permuted across the processors).
www.top500.org /ORSC/1998/dm-simd.html   (880 words)

Try your search on: Qwika (all wikis)

Factbites
  About us   |   Why use us?   |   Reviews   |   Press   |   Contact us  
Copyright © 2005-2007 www.factbites.com Usage implies agreement with terms.