Human Generated Data

Title

Untitled (outdoor wedding reception)

Date

c, 1970

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.532

Human Generated Data

Title

Untitled (outdoor wedding reception)

People

Artist: Bachrach Studios, founded 1868

Date

c, 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.5
Human 99.5
Person 99.4
Person 99.3
Person 99.3
Person 98.9
Person 98.6
Person 98.6
Person 98.4
Person 97.9
Person 97.5
Person 96.6
Person 96.3
Watercraft 96.1
Vessel 96.1
Transportation 96.1
Vehicle 96.1
Water 95.3
Waterfront 95.3
Person 94.9
Clothing 94.8
Apparel 94.8
Person 93.1
Boat 92
Pier 88.9
Dock 88.9
Port 88.9
Person 88
Person 80.7
Person 80.6
Boat 79.6
Person 79
Person 77.8
Person 76.9
Person 75.4
Boat 74.4
Person 73.2
Person 69.2
Person 67.6
Crowd 67.4
Person 65.8
Fashion 59.7
Person 59.3
Gown 58.2
Person 57.5
Robe 56.4
Boat 50
Person 45.2

Imagga
created on 2022-02-26

sea 36.8
water 32.7
boat 29.4
ocean 27.5
travel 26
tourist 23.5
tourism 23.1
ship 22.6
sky 22.4
beach 22.2
city 21.6
coast 21.5
landscape 18.6
vacation 16.4
river 16
pedestrian 15.8
town 15.8
boats 15.5
shore 15.5
lake 14.6
building 14.4
fishing 14.4
clouds 14.4
bay 14.3
summer 14.1
vessel 14
people 13.9
vehicle 13.5
port 13.5
architecture 13.3
panorama 12.4
spectator 12.3
unicycle 12
sport 11.9
photographer 11.8
harbor 11.5
scenic 11.4
rock 11.3
wheeled vehicle 10.8
urban 10.5
cityscape 10.4
buildings 10.4
person 10.2
waves 10.2
marina 10.1
leisure 10
structure 9.9
sail 9.7
yacht 9.6
sand 9.6
rocks 9.4
day 9.4
house 9.2
fisherman 9.1
seaside 9.1
traveler 8.8
nautical 8.7
skyline 8.5
coastline 8.5
sports 8.3
island 8.2
outdoors 8.2
tower 8.2
sun 8
quay 7.9
sailing 7.8
coastal 7.8
aerial 7.8
st 7.8
houses 7.7
old 7.7
bridge 7.6
hill 7.5
craft 7.3
landmark 7.2
scenery 7.2
history 7.2
sailboat 7.1

Google
created on 2022-02-26

Water 97.3
Boat 94.6
Photograph 94.2
Sky 91.6
Watercraft 91
Human 89.7
Travel 81.9
Vehicle 81.4
Leisure 81.2
Crowd 80.1
Beach 74.1
Fun 73.2
Event 71.8
Shore 71.2
Horizon 70.4
Ship 70.4
Lake 69.7
Coast 69.6
Suit 66.4
Stock photography 63.8

Microsoft
created on 2022-02-26

ship 98.1
outdoor 98
person 96.3
people 87
vehicle 69.5
watercraft 68.7
boat 65.8
clothing 64.8
water 62
man 61.5
crowd 33.9

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 98%
Happy 62.4%
Calm 33.9%
Surprised 1.6%
Disgusted 1%
Confused 0.4%
Sad 0.3%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 26-36
Gender Male, 99.6%
Calm 99.5%
Happy 0.4%
Confused 0%
Surprised 0%
Disgusted 0%
Fear 0%
Angry 0%
Sad 0%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Happy 83.7%
Disgusted 10.7%
Calm 1.7%
Surprised 1.5%
Angry 0.9%
Confused 0.8%
Sad 0.4%
Fear 0.3%

AWS Rekognition

Age 29-39
Gender Male, 67.4%
Fear 41.9%
Calm 27.2%
Sad 18.5%
Confused 4.4%
Surprised 2.6%
Happy 2.6%
Angry 2.2%
Disgusted 0.6%

AWS Rekognition

Age 9-17
Gender Male, 98.6%
Calm 98.6%
Sad 1.1%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0%
Surprised 0%
Confused 0%

AWS Rekognition

Age 38-46
Gender Male, 99.7%
Disgusted 96.7%
Sad 1.3%
Calm 0.8%
Angry 0.6%
Confused 0.2%
Happy 0.2%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 38-46
Gender Male, 99.8%
Happy 65.5%
Calm 23.3%
Confused 4%
Surprised 1.8%
Disgusted 1.6%
Sad 1.6%
Angry 1.4%
Fear 0.9%

AWS Rekognition

Age 20-28
Gender Male, 95.8%
Disgusted 80.2%
Sad 15.4%
Happy 2.1%
Confused 0.7%
Angry 0.7%
Calm 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 19-27
Gender Female, 66.5%
Disgusted 66.3%
Calm 23.5%
Angry 2.8%
Sad 2.6%
Fear 1.6%
Happy 1.2%
Confused 1.2%
Surprised 0.9%

AWS Rekognition

Age 21-29
Gender Male, 99.7%
Happy 90.1%
Calm 3.6%
Sad 2%
Confused 1.4%
Angry 0.9%
Disgusted 0.8%
Fear 0.7%
Surprised 0.6%

AWS Rekognition

Age 38-46
Gender Female, 60.7%
Calm 93.3%
Sad 1.3%
Angry 1.2%
Surprised 1.1%
Happy 1.1%
Confused 0.9%
Disgusted 0.7%
Fear 0.4%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Calm 56.8%
Sad 31.3%
Happy 4.4%
Confused 2.9%
Angry 1.5%
Fear 1.5%
Surprised 1%
Disgusted 0.6%

AWS Rekognition

Age 23-31
Gender Male, 97.4%
Happy 53.5%
Calm 27.4%
Surprised 7.5%
Fear 5.8%
Angry 2.3%
Disgusted 1.7%
Sad 1.3%
Confused 0.5%

AWS Rekognition

Age 54-62
Gender Male, 89.1%
Calm 53.4%
Sad 21.6%
Happy 15.2%
Confused 3.5%
Fear 3.5%
Disgusted 1.2%
Angry 1%
Surprised 0.6%

AWS Rekognition

Age 27-37
Gender Female, 82.2%
Sad 54.4%
Calm 43%
Disgusted 0.6%
Fear 0.6%
Angry 0.4%
Happy 0.4%
Confused 0.3%
Surprised 0.3%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Sad 99.1%
Calm 0.6%
Confused 0.2%
Angry 0%
Disgusted 0%
Fear 0%
Surprised 0%
Happy 0%

AWS Rekognition

Age 19-27
Gender Male, 54%
Calm 91.7%
Angry 5.5%
Sad 2.2%
Confused 0.2%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 50-58
Gender Male, 97.6%
Sad 39%
Happy 27.3%
Disgusted 7.7%
Calm 7.7%
Angry 5.8%
Fear 5.4%
Surprised 4%
Confused 3.1%

AWS Rekognition

Age 28-38
Gender Male, 99.1%
Disgusted 95.7%
Angry 0.9%
Happy 0.9%
Fear 0.7%
Sad 0.6%
Confused 0.5%
Calm 0.4%
Surprised 0.3%

AWS Rekognition

Age 41-49
Gender Male, 67.4%
Happy 76.9%
Sad 10.8%
Calm 4.1%
Surprised 3.6%
Angry 1.8%
Disgusted 1.2%
Fear 0.8%
Confused 0.8%

AWS Rekognition

Age 13-21
Gender Female, 53.9%
Calm 79.7%
Happy 12.6%
Fear 3.4%
Confused 2%
Disgusted 1.2%
Surprised 0.6%
Angry 0.3%
Sad 0.2%

AWS Rekognition

Age 1-7
Gender Female, 99.9%
Sad 32.6%
Calm 27.6%
Happy 20.6%
Angry 7.2%
Disgusted 4%
Fear 3.4%
Confused 2.4%
Surprised 2.1%

AWS Rekognition

Age 35-43
Gender Male, 76.3%
Calm 99%
Happy 0.7%
Angry 0.1%
Sad 0.1%
Confused 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Male, 96.3%
Calm 87.8%
Sad 6.4%
Fear 1.4%
Happy 1.3%
Disgusted 1.1%
Confused 0.8%
Angry 0.7%
Surprised 0.5%

AWS Rekognition

Age 14-22
Gender Male, 99.9%
Calm 57.2%
Angry 19%
Happy 9.2%
Sad 7%
Surprised 2.9%
Fear 2.8%
Disgusted 1.3%
Confused 0.6%

AWS Rekognition

Age 18-26
Gender Female, 56.9%
Calm 64.8%
Happy 22.4%
Disgusted 3.8%
Angry 2.4%
Surprised 2%
Confused 2%
Fear 1.4%
Sad 1.2%

AWS Rekognition

Age 19-27
Gender Male, 95.9%
Calm 88.9%
Disgusted 2.9%
Angry 2.8%
Fear 1.9%
Confused 1.4%
Happy 0.8%
Sad 0.7%
Surprised 0.6%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Calm 88.6%
Happy 3.1%
Fear 2.3%
Sad 2.1%
Disgusted 1.8%
Angry 1%
Surprised 0.7%
Confused 0.5%

AWS Rekognition

Age 45-51
Gender Female, 64.5%
Calm 55.8%
Happy 31.2%
Angry 4.9%
Disgusted 2.7%
Sad 2.2%
Surprised 1.5%
Fear 0.8%
Confused 0.8%

AWS Rekognition

Age 21-29
Gender Male, 92.2%
Happy 90.7%
Fear 4.1%
Calm 3%
Surprised 0.6%
Angry 0.6%
Disgusted 0.5%
Sad 0.5%
Confused 0.1%

AWS Rekognition

Age 12-20
Gender Male, 98.5%
Calm 96.5%
Angry 1.2%
Sad 1.1%
Disgusted 0.4%
Confused 0.3%
Happy 0.2%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 29-39
Gender Male, 56.8%
Happy 73.7%
Calm 16.4%
Sad 5.3%
Fear 1.2%
Disgusted 1.1%
Angry 0.9%
Surprised 0.7%
Confused 0.7%

AWS Rekognition

Age 20-28
Gender Male, 65.4%
Happy 39.9%
Calm 19.8%
Surprised 10%
Sad 9%
Angry 8.9%
Fear 5.7%
Disgusted 3.8%
Confused 2.9%

AWS Rekognition

Age 11-19
Gender Male, 97.4%
Calm 94.5%
Sad 2.6%
Fear 1.2%
Angry 0.7%
Happy 0.4%
Disgusted 0.3%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 45.1%
Happy 23.7%
Disgusted 7.6%
Fear 5.7%
Sad 5.2%
Angry 4.6%
Surprised 4.3%
Confused 3.8%

AWS Rekognition

Age 16-22
Gender Male, 99.9%
Calm 69.7%
Sad 18.6%
Happy 6.2%
Angry 1.6%
Confused 1.5%
Fear 1.3%
Surprised 0.6%
Disgusted 0.6%

AWS Rekognition

Age 25-35
Gender Male, 80%
Calm 30.1%
Confused 24.3%
Sad 13.9%
Fear 11.8%
Disgusted 6.6%
Happy 5.6%
Angry 5.6%
Surprised 2.2%

AWS Rekognition

Age 23-31
Gender Male, 99.6%
Calm 52.1%
Disgusted 35.7%
Happy 4.2%
Sad 2.5%
Angry 1.8%
Confused 1.5%
Fear 1.4%
Surprised 0.7%

AWS Rekognition

Age 21-29
Gender Male, 68%
Calm 98.4%
Angry 0.5%
Sad 0.4%
Confused 0.2%
Surprised 0.2%
Happy 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 10-18
Gender Male, 98.9%
Calm 71%
Sad 19.9%
Happy 4.6%
Angry 2.7%
Disgusted 0.8%
Confused 0.5%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 22-30
Gender Male, 96.8%
Calm 97%
Happy 0.9%
Surprised 0.6%
Sad 0.6%
Disgusted 0.4%
Angry 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 7-17
Gender Male, 93.5%
Calm 89.8%
Sad 2.6%
Fear 1.9%
Happy 1.8%
Disgusted 1.4%
Angry 1.2%
Confused 0.7%
Surprised 0.7%

AWS Rekognition

Age 18-24
Gender Male, 65%
Calm 67.6%
Disgusted 10.2%
Sad 6%
Happy 5%
Angry 4.1%
Surprised 2.9%
Confused 2.7%
Fear 1.5%

AWS Rekognition

Age 20-28
Gender Male, 65.3%
Sad 64.3%
Calm 27%
Fear 2.4%
Confused 2.2%
Disgusted 1.5%
Happy 1.5%
Angry 0.6%
Surprised 0.6%

AWS Rekognition

Age 41-49
Gender Female, 60.6%
Happy 37%
Calm 36.3%
Sad 18.1%
Confused 3.2%
Disgusted 1.8%
Fear 1.8%
Angry 1%
Surprised 0.8%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 62.1%
Sad 19.8%
Angry 6.1%
Fear 4.5%
Surprised 2.4%
Happy 2.1%
Confused 2%
Disgusted 1.1%

AWS Rekognition

Age 16-22
Gender Male, 95.7%
Calm 98.4%
Sad 0.5%
Angry 0.2%
Happy 0.2%
Confused 0.2%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Male, 88.1%
Calm 95.1%
Confused 1.9%
Happy 1.3%
Sad 0.8%
Disgusted 0.3%
Fear 0.3%
Angry 0.2%
Surprised 0.2%

AWS Rekognition

Age 23-31
Gender Male, 98.3%
Calm 81.2%
Sad 9.7%
Happy 7.6%
Angry 0.4%
Disgusted 0.3%
Fear 0.3%
Confused 0.3%
Surprised 0.2%

AWS Rekognition

Age 16-24
Gender Male, 99.9%
Calm 94.4%
Happy 3.1%
Sad 1.4%
Disgusted 0.5%
Angry 0.2%
Fear 0.1%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 27-37
Gender Male, 60.8%
Calm 42.3%
Happy 17.7%
Disgusted 10.6%
Angry 8.7%
Sad 7.5%
Surprised 5.5%
Confused 4.9%
Fear 2.6%

AWS Rekognition

Age 10-18
Gender Male, 99.9%
Calm 73.9%
Happy 14.8%
Sad 5.2%
Angry 3.5%
Fear 1.3%
Disgusted 0.6%
Confused 0.6%
Surprised 0.2%

AWS Rekognition

Age 6-16
Gender Male, 87.4%
Calm 73.2%
Happy 22.6%
Fear 2.4%
Sad 0.6%
Disgusted 0.5%
Confused 0.3%
Angry 0.2%
Surprised 0.2%

AWS Rekognition

Age 22-30
Gender Male, 61.9%
Calm 47.7%
Confused 17.3%
Sad 15.4%
Fear 4.9%
Surprised 4.3%
Angry 3.9%
Disgusted 3.6%
Happy 3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Boat 92%

Captions

Microsoft

a crowd of people at a beach 98.8%
a large crowd of people at a beach 98.6%
a group of people on a beach 97.4%