Human Generated Data

Title

Untitled (buffet tables outside at wedding)

Date

c. 1950

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18916

Human Generated Data

Title

Untitled (buffet tables outside at wedding)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.3
Human 99.3
Person 99.2
Person 98.6
Person 98.3
Person 97.1
Person 97.1
Market 82.6
Clothing 78.9
Apparel 78.9
Person 76.7
Outdoors 73.9
Nature 72
Bazaar 70.1
Shop 70.1
Face 67.6
Food 67.1
Meal 67.1
Furniture 65.7
People 64.5
Transportation 63.8
Boat 63.8
Vehicle 63.8
Female 60.2
Table 59.2
Crowd 58.5
Indoors 57.9
Theme Park 56
Amusement Park 56

Imagga
created on 2022-03-05

canvas tent 39.2
stage 27.8
sea 25.5
platform 24.7
boat 24.1
sky 23.6
travel 23.2
percussion instrument 22.3
water 19.3
marimba 18.6
musical instrument 18.1
ocean 17.5
tourism 16.5
vacation 13.9
clouds 13.5
building 13.5
ship 12.6
architecture 12.5
city 12.5
shore 12.1
sun 12.1
marina 12
island 11.9
landscape 11.9
dock 11.7
boats 11.6
holiday 11.5
beach 11.1
transport 10.9
summer 10.9
house 10.9
sunset 10.8
coast 10.8
transportation 10.8
harbor 10.6
stall 10.5
resort 9.9
silhouette 9.9
fishing 9.6
day 9.4
yacht 8.8
chair 8.7
structure 8.7
port 8.7
bridge 8.5
business 8.5
umbrella 8.5
bay 8.5
vacations 8.5
outdoor 8.4
wood 8.3
leisure 8.3
urban 7.9
pier 7.8
sail 7.8
craft 7.7
construction 7.7
old 7.7
dusk 7.6
cityscape 7.6
evening 7.5
area 7.5
outdoors 7.5
vessel 7.3
people 7.2
color 7.2
home 7.2
work 7.1

Google
created on 2022-03-05

Black 89.7
Black-and-white 85.3
Tent 84.3
Style 84
Table 83.2
Public space 80.8
Shade 77.4
Tablecloth 75.8
Monochrome photography 75.7
Monochrome 75
Art 73.2
Event 71.5
City 67.3
Canopy 64.1
Recreation 63.9
Stock photography 63.3
History 62.7
Fashion accessory 61.7
Linens 61.3
Pattern 60.3

Microsoft
created on 2022-03-05

sky 99.4
outdoor 93.5
person 71.9
clothing 67.6
text 64
table 63.8
old 40.2

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 66.7%
Calm 86%
Surprised 4.7%
Angry 4.3%
Happy 2%
Sad 1.1%
Confused 1%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 34-42
Gender Male, 91.9%
Calm 43.5%
Sad 41.4%
Confused 5.8%
Fear 4.7%
Happy 1.9%
Disgusted 1.4%
Surprised 0.7%
Angry 0.6%

AWS Rekognition

Age 33-41
Gender Female, 71%
Calm 96.5%
Sad 2.7%
Confused 0.3%
Happy 0.2%
Disgusted 0.2%
Surprised 0.1%
Angry 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Boat 63.8%

Captions

Microsoft

a group of people on a boat 72.1%
a group of people in a boat 72%
a group of people riding on the back of a boat 49.8%

Text analysis

Amazon

20151

Google

MJI7--YT3RA°2-
MJI7--YT3RA°2- -XAGON
-XAGON