Human Generated Data

Title

Untitled (enormous crowd of people on city street, seen from above)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14563

Human Generated Data

Title

Untitled (enormous crowd of people on city street, seen from above)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Architecture 91
Building 91
Crowd 88.1
Rug 85.1
Mecca 77
Column 63.6
Pillar 63.6
Text 60.5
Audience 59.9
Clothing 56.5
Overcoat 56.5
Coat 56.5
Suit 56.5
Apparel 56.5

Imagga
created on 2022-01-29

memorial 48.4
grunge 46.8
gravestone 42.9
texture 39.6
structure 39.5
old 36.2
vintage 33.9
antique 32.2
retro 31.1
frame 30
rough 29.2
border 28.1
pattern 28
stone 27.9
damaged 27.7
material 26.8
wall 26.1
grungy 24.7
aged 24.4
dirty 24.4
design 23.6
space 22.5
art 22.2
paper 22
graphic 21.9
rusty 21
wallpaper 19.9
messy 19.3
textured 19.3
weathered 18.1
text 17.5
rust 17.3
ancient 17.3
parchment 17.3
empty 17.2
surface 16.8
backdrop 16.5
paint 16.3
blank 16.3
grain 15.7
landscape 15.6
snow 15.5
blackboard 15.5
brass 15.4
film 15
doormat 14.5
negative 14.4
black 13.8
canvas 13.3
color 12.8
winter 12.8
stains 12.6
decay 12.5
backgrounds 12.2
scratch 11.7
decoration 11.7
edge 11.5
stain 11.5
mat 11.5
worn 11.5
tree 11.4
dark 10.9
noise 10.8
ragged 10.7
movie 10.7
collage 10.6
detailed 10.6
stained 10.6
spot 10.5
dirt 10.5
sheet 10.3
season 10.1
noisy 9.9
scratches 9.9
designed 9.8
frames 9.8
mottled 9.7
digital 9.7
burnt 9.7
crumpled 9.7
your 9.7
frost 9.6
aging 9.6
obsolete 9.6
old fashioned 9.5
plant 9.5
cold 9.5
scenery 9
highly 8.9
layered 8.8
mess 8.8
broad 8.8
photographic 8.8
grime 8.8
slide 8.8
tracery 8.8
fracture 8.8
faded 8.8
succulent 8.7
strip 8.7
crack 8.7
torn 8.7
forest 8.7
floor cover 8.7
layer 8.7
mask 8.6
historic 8.3
outdoors 8.2
brown 8.1
metal 8
close 8
burned 7.8
crease 7.8
artistic 7.8
screen 7.8
nobody 7.8
card 7.7
covering 7.5
fence 7.5
field 7.5
page 7.4
branch 7.3
computer 7.2
horizon 7.2
trees 7.1
weather 7.1
scenic 7

Google
created on 2022-01-29

Black 89.6
Organism 85.3
Black-and-white 85.2
Rectangle 84.6
Font 83.8
Adaptation 79.3
Monochrome photography 76.6
Monochrome 75.7
Event 66.1
Art 65.5
Pattern 63.9
History 63.6
Stock photography 61.9
Urban design 61.5
Grass 61.1
Room 60.7
Crowd 59.8
Soil 56.3
Visual arts 55.9
Paper product 55.2

Microsoft
created on 2022-01-29

outdoor 97.7
text 78.9
white 72.1

Face analysis

Amazon

AWS Rekognition

Age 23-31
Gender Male, 92.1%
Happy 64.6%
Calm 25%
Disgusted 2.5%
Sad 2.2%
Confused 2%
Angry 1.6%
Surprised 1%
Fear 1%

AWS Rekognition

Age 27-37
Gender Male, 68.2%
Happy 98.8%
Calm 0.5%
Angry 0.2%
Sad 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 12-20
Gender Female, 61.3%
Calm 84.2%
Sad 14.3%
Happy 0.7%
Angry 0.3%
Confused 0.3%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 35-43
Gender Male, 89.2%
Calm 66.2%
Sad 18.9%
Happy 6.5%
Angry 3%
Fear 2.6%
Surprised 1.2%
Disgusted 0.9%
Confused 0.7%

AWS Rekognition

Age 38-46
Gender Female, 77.2%
Calm 42.9%
Happy 36.6%
Sad 15.5%
Disgusted 1.4%
Angry 1.4%
Confused 1.2%
Surprised 0.6%
Fear 0.4%

AWS Rekognition

Age 21-29
Gender Male, 92.8%
Calm 99.7%
Sad 0.2%
Angry 0.1%
Happy 0%
Confused 0%
Fear 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 37-45
Gender Male, 99.4%
Happy 82%
Calm 6.9%
Disgusted 4.1%
Sad 3%
Confused 1.5%
Angry 1.2%
Surprised 0.8%
Fear 0.5%

AWS Rekognition

Age 26-36
Gender Male, 95.5%
Calm 88%
Happy 6.5%
Sad 3.1%
Angry 0.8%
Disgusted 0.7%
Surprised 0.4%
Confused 0.4%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Female, 67%
Calm 97.4%
Sad 1%
Happy 0.5%
Confused 0.4%
Disgusted 0.3%
Angry 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 99.4%
Confused 36.6%
Calm 32.8%
Sad 25.9%
Happy 1.8%
Angry 0.8%
Disgusted 0.8%
Fear 0.7%
Surprised 0.6%

AWS Rekognition

Age 27-37
Gender Male, 99.3%
Calm 70.5%
Happy 19.3%
Sad 3.8%
Disgusted 1.7%
Angry 1.4%
Surprised 1.3%
Fear 1.1%
Confused 1%

AWS Rekognition

Age 27-37
Gender Male, 97.8%
Calm 66.9%
Angry 18.7%
Happy 5.1%
Surprised 4.4%
Disgusted 2.3%
Sad 1.2%
Confused 0.8%
Fear 0.7%

AWS Rekognition

Age 22-30
Gender Female, 56.4%
Sad 70.4%
Calm 22.1%
Disgusted 2%
Confused 1.6%
Happy 1.4%
Surprised 1.1%
Angry 1%
Fear 0.6%

AWS Rekognition

Age 40-48
Gender Female, 72.9%
Disgusted 34%
Sad 32.4%
Calm 14.7%
Confused 7.8%
Angry 6.1%
Happy 2.6%
Surprised 1.5%
Fear 1.1%

AWS Rekognition

Age 23-33
Gender Female, 61.4%
Calm 46.6%
Happy 34.5%
Sad 7.3%
Confused 6%
Angry 2.5%
Fear 1.3%
Disgusted 1.1%
Surprised 0.8%

AWS Rekognition

Age 19-27
Gender Female, 99.4%
Happy 48.6%
Angry 22.5%
Calm 14.8%
Sad 5.7%
Confused 2.7%
Disgusted 2.2%
Fear 2.1%
Surprised 1.4%

AWS Rekognition

Age 20-28
Gender Female, 73.7%
Happy 57.6%
Sad 17.5%
Confused 15.9%
Calm 5.4%
Disgusted 1.7%
Angry 0.7%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 14-22
Gender Male, 96.2%
Happy 73.1%
Calm 13%
Sad 5%
Surprised 4.9%
Fear 1.2%
Confused 1.1%
Angry 1.1%
Disgusted 0.5%

AWS Rekognition

Age 18-26
Gender Female, 96.9%
Calm 94.1%
Sad 2.4%
Happy 1.4%
Disgusted 0.7%
Surprised 0.6%
Fear 0.3%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 22-30
Gender Male, 82.4%
Calm 48.2%
Sad 45.2%
Happy 3.8%
Angry 0.9%
Fear 0.7%
Confused 0.6%
Surprised 0.4%
Disgusted 0.2%

AWS Rekognition

Age 25-35
Gender Female, 56.9%
Calm 42.1%
Sad 26.3%
Angry 14.6%
Happy 9.1%
Disgusted 2.7%
Surprised 2.1%
Confused 1.6%
Fear 1.4%

AWS Rekognition

Age 21-29
Gender Male, 95.1%
Disgusted 35.2%
Sad 22%
Confused 19.2%
Calm 10.4%
Angry 5.7%
Fear 3.5%
Happy 2.1%
Surprised 1.9%

AWS Rekognition

Age 36-44
Gender Female, 93.1%
Sad 99.5%
Calm 0.2%
Happy 0.2%
Confused 0.1%
Fear 0%
Angry 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 16-22
Gender Female, 52.6%
Happy 82.6%
Calm 7.8%
Sad 5.3%
Fear 2.4%
Angry 0.9%
Disgusted 0.5%
Surprised 0.4%
Confused 0.3%

AWS Rekognition

Age 19-27
Gender Male, 97.9%
Calm 55.9%
Happy 39.3%
Sad 2.9%
Angry 0.6%
Fear 0.4%
Confused 0.4%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 9-17
Gender Female, 89.5%
Happy 72.6%
Calm 24.7%
Sad 1.2%
Surprised 0.4%
Disgusted 0.4%
Fear 0.3%
Angry 0.3%
Confused 0.3%

AWS Rekognition

Age 12-20
Gender Male, 91.9%
Happy 61.9%
Calm 11.9%
Fear 10.3%
Sad 8.6%
Angry 2.6%
Surprised 2%
Disgusted 1.8%
Confused 0.8%

AWS Rekognition

Age 18-26
Gender Male, 99.7%
Calm 75.4%
Happy 7.7%
Disgusted 4.5%
Fear 4.4%
Surprised 3.7%
Confused 2%
Angry 1.3%
Sad 1%

AWS Rekognition

Age 27-37
Gender Female, 64.5%
Angry 46.3%
Confused 17%
Happy 13.9%
Disgusted 11.6%
Sad 6.3%
Calm 2.1%
Surprised 2.1%
Fear 0.8%

AWS Rekognition

Age 27-37
Gender Male, 98%
Happy 57.6%
Calm 15.5%
Confused 14.3%
Disgusted 4%
Sad 3.8%
Fear 3.2%
Surprised 0.9%
Angry 0.7%

AWS Rekognition

Age 18-24
Gender Male, 89.5%
Disgusted 40.4%
Calm 22.7%
Sad 17.2%
Confused 7%
Angry 5.8%
Happy 3.5%
Fear 2.2%
Surprised 1.1%

AWS Rekognition

Age 29-39
Gender Male, 96.6%
Happy 50.2%
Calm 28.4%
Sad 14.1%
Angry 2.3%
Surprised 2.1%
Fear 1.8%
Disgusted 0.8%
Confused 0.3%

AWS Rekognition

Age 20-28
Gender Male, 73.5%
Sad 57.2%
Calm 36.3%
Fear 2.8%
Angry 1%
Disgusted 0.9%
Confused 0.8%
Happy 0.8%
Surprised 0.3%

AWS Rekognition

Age 16-24
Gender Male, 70.9%
Calm 59.3%
Happy 10.3%
Angry 10%
Sad 8.3%
Fear 5.5%
Confused 3.9%
Disgusted 1.7%
Surprised 1%

AWS Rekognition

Age 16-24
Gender Female, 52.8%
Calm 42.7%
Fear 36.3%
Sad 11.6%
Happy 6.9%
Angry 1%
Confused 0.8%
Disgusted 0.5%
Surprised 0.2%

AWS Rekognition

Age 23-31
Gender Male, 98.7%
Sad 65.7%
Calm 29.6%
Surprised 2.3%
Disgusted 0.9%
Fear 0.5%
Confused 0.4%
Happy 0.3%
Angry 0.3%

AWS Rekognition

Age 16-24
Gender Female, 61.5%
Sad 72.8%
Calm 13.5%
Happy 5.1%
Disgusted 3.4%
Confused 1.9%
Surprised 1.2%
Angry 1.1%
Fear 0.9%

AWS Rekognition

Age 30-40
Gender Female, 91.1%
Happy 94.9%
Sad 1.8%
Calm 1.7%
Angry 0.6%
Surprised 0.3%
Disgusted 0.3%
Fear 0.3%
Confused 0.1%

AWS Rekognition

Age 6-16
Gender Male, 75.5%
Calm 65%
Sad 24.5%
Happy 4.4%
Angry 1.7%
Surprised 1.6%
Fear 1.2%
Disgusted 1%
Confused 0.6%

AWS Rekognition

Age 21-29
Gender Female, 63.9%
Calm 92.6%
Sad 4.3%
Happy 1.5%
Disgusted 0.5%
Angry 0.4%
Fear 0.3%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 19-27
Gender Female, 78.6%
Calm 91.1%
Sad 3.3%
Happy 3%
Angry 0.8%
Disgusted 0.7%
Confused 0.4%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 21-29
Gender Male, 97.5%
Calm 89.3%
Happy 6.7%
Sad 2.3%
Angry 0.5%
Disgusted 0.4%
Fear 0.4%
Surprised 0.3%
Confused 0.1%

AWS Rekognition

Age 54-62
Gender Male, 84.1%
Calm 99.8%
Happy 0%
Confused 0%
Surprised 0%
Disgusted 0%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 16-22
Gender Female, 67.8%
Sad 63.8%
Calm 20.1%
Angry 4.1%
Happy 2.8%
Confused 2.8%
Surprised 2.3%
Disgusted 2.3%
Fear 1.8%

AWS Rekognition

Age 16-22
Gender Female, 85.7%
Calm 86%
Happy 9.8%
Sad 2.5%
Angry 0.5%
Disgusted 0.4%
Surprised 0.3%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 14-22
Gender Male, 96.8%
Calm 81.1%
Sad 10.2%
Fear 3.1%
Confused 2.3%
Angry 1.4%
Happy 0.9%
Surprised 0.5%
Disgusted 0.4%

AWS Rekognition

Age 6-12
Gender Male, 69.6%
Happy 73.9%
Sad 15%
Calm 8.7%
Confused 0.5%
Fear 0.5%
Surprised 0.5%
Angry 0.5%
Disgusted 0.4%

AWS Rekognition

Age 20-28
Gender Male, 90.9%
Calm 39.2%
Angry 36.5%
Sad 9.5%
Surprised 4.4%
Disgusted 3.5%
Confused 2.9%
Fear 2.5%
Happy 1.6%

AWS Rekognition

Age 23-33
Gender Male, 93.7%
Sad 54.2%
Calm 27.5%
Confused 6.8%
Happy 3.3%
Angry 3.1%
Disgusted 2.2%
Surprised 1.5%
Fear 1.4%

AWS Rekognition

Age 26-36
Gender Female, 95.3%
Calm 37.3%
Sad 27.6%
Happy 10.6%
Fear 9.3%
Confused 6.1%
Disgusted 4.5%
Angry 2.9%
Surprised 1.6%

AWS Rekognition

Age 2-8
Gender Male, 87.6%
Calm 87.1%
Happy 4.1%
Angry 3.3%
Sad 2.6%
Fear 1.4%
Disgusted 0.6%
Surprised 0.5%
Confused 0.4%

AWS Rekognition

Age 11-19
Gender Female, 85%
Calm 90.6%
Happy 4.5%
Sad 1.5%
Surprised 1.1%
Fear 0.7%
Disgusted 0.7%
Angry 0.6%
Confused 0.4%

AWS Rekognition

Age 27-37
Gender Female, 50.5%
Sad 77.3%
Calm 9.1%
Happy 4.2%
Fear 3.3%
Angry 2.6%
Disgusted 1.3%
Confused 1.1%
Surprised 1%

AWS Rekognition

Age 33-41
Gender Male, 79.1%
Happy 75.9%
Sad 7.8%
Fear 7%
Calm 5.2%
Surprised 1.8%
Disgusted 1%
Angry 0.9%
Confused 0.4%

AWS Rekognition

Age 21-29
Gender Male, 97.2%
Calm 38.3%
Disgusted 19.8%
Fear 15.5%
Happy 10.3%
Sad 9.1%
Confused 2.8%
Angry 2.4%
Surprised 1.7%

AWS Rekognition

Age 31-41
Gender Male, 98.7%
Sad 53.8%
Happy 20.5%
Confused 7.5%
Disgusted 6.2%
Calm 4.2%
Fear 3.8%
Angry 2.8%
Surprised 1.3%

AWS Rekognition

Age 25-35
Gender Male, 80.9%
Confused 86.1%
Calm 7.4%
Sad 1.9%
Surprised 1.3%
Happy 1.1%
Angry 1.1%
Disgusted 0.6%
Fear 0.6%

AWS Rekognition

Age 23-33
Gender Male, 88.9%
Calm 94.1%
Sad 2.4%
Happy 1.6%
Disgusted 0.6%
Angry 0.5%
Fear 0.3%
Confused 0.3%
Surprised 0.2%

AWS Rekognition

Age 45-51
Gender Female, 58.1%
Calm 63.6%
Sad 23.3%
Confused 5.2%
Happy 3.4%
Angry 2.3%
Disgusted 1.3%
Surprised 0.6%
Fear 0.4%

AWS Rekognition

Age 38-46
Gender Female, 66.4%
Calm 74.5%
Sad 14.6%
Happy 9.1%
Disgusted 0.6%
Confused 0.5%
Angry 0.3%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 21-29
Gender Female, 87.3%
Calm 38.1%
Happy 33%
Sad 24.2%
Angry 1.1%
Surprised 1.1%
Fear 1%
Disgusted 1%
Confused 0.5%

AWS Rekognition

Age 21-29
Gender Female, 55.3%
Calm 50.4%
Happy 38.9%
Sad 7%
Angry 1.4%
Surprised 0.7%
Disgusted 0.6%
Confused 0.6%
Fear 0.5%

AWS Rekognition

Age 30-40
Gender Male, 80.8%
Happy 84.5%
Calm 12.8%
Sad 0.9%
Fear 0.9%
Confused 0.2%
Surprised 0.2%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 10-18
Gender Male, 99.9%
Calm 97.6%
Confused 0.8%
Sad 0.5%
Surprised 0.3%
Happy 0.3%
Fear 0.2%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 24-34
Gender Male, 84.3%
Calm 95.8%
Sad 1.7%
Confused 1%
Angry 0.9%
Happy 0.5%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 98.9%
Calm 63.3%
Happy 31%
Disgusted 2.1%
Angry 1.5%
Sad 0.7%
Confused 0.6%
Fear 0.5%
Surprised 0.4%

Feature analysis

Amazon

Rug 85.1%

Captions

Microsoft

an old photo of a train 31.7%
a group of people in a field 31.6%
a group of people on a field 31.5%

Text analysis

Amazon

CREAM
MJIR
MJIR YTERAS A70A
0
A70A
YTERAS

Google

MJIR YT3RA2 AA BSLLS 112
MJIR
YT3RA2
AA
BSLLS
112