Human Generated Data

Title

Untitled (two men and woman walking)

Date

1959

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18975

Human Generated Data

Title

Untitled (two men and woman walking)

People

Artist: Bachrach Studios, founded 1868

Date

1959

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Apparel 99.9
Clothing 99.9
Human 98.3
Person 98.2
Robe 97.8
Fashion 97.8
Person 97.7
Person 97
Gown 96.1
Footwear 95.7
Shoe 95.7
Car 95.6
Transportation 95.6
Vehicle 95.6
Automobile 95.6
Shoe 95.6
Dress 94.3
Wedding 94
Female 93.2
Car 92.1
Wedding Gown 89.2
Bride 89.2
Bridegroom 88.9
Sailor Suit 88.4
Overcoat 83.8
Coat 83.8
Suit 83.8
Face 81.9
Woman 81.6
Outdoors 78.6
Nature 77.7
Home Decor 75.7
Chair 74.9
Furniture 74.9
Sea 74.2
Water 74.2
Ocean 74.2
Evening Dress 73.8
Photo 73.4
Portrait 73.4
Photography 73.4
Plant 72.1
Wheel 68.4
Machine 68.4
Wheel 64.1
Shoreline 61.9
Coast 61.9
Beach 61.9
Sleeve 58.5
Shoe 58.1
Tree 57.7
Swimming Pool 56.1
Pool 56.1
Long Sleeve 55.2
Person 55

Imagga
created on 2022-03-05

architecture 20.5
sky 20.4
city 19.9
travel 18.3
groom 18.2
building 17.5
park 17.4
day 17.3
bride 15.6
people 15.1
wedding 14.7
tourism 13.2
couple 13.1
person 13
tree 12.7
structure 12.6
two 11.9
outdoors 11.8
dress 11.7
landmark 11.7
sculpture 11.7
culture 11.1
snow 11.1
happiness 11
married 10.5
tourist 10.5
urban 10.5
summer 10.3
man 10.1
outdoor 9.9
history 9.8
old 9.7
statue 9.7
landscape 9.7
house 9.5
scene 9.5
marriage 9.5
love 9.5
water 9.3
fence 9.3
field 9.2
romantic 8.9
group 8.9
celebration 8.8
adult 8.7
men 8.6
male 8.5
portrait 8.4
traditional 8.3
mountain 8
column 7.9
veil 7.8
palace 7.6
place 7.4
famous 7.4
street 7.4
horse 7.3
smiling 7.2
color 7.2
transportation 7.2
river 7.1
family 7.1
trees 7.1
resort 7

Google
created on 2022-03-05

Black 89.6
Flash photography 86.2
Gesture 85.3
Black-and-white 84.6
Style 84
Plant 82.8
Line 81.9
Adaptation 79.4
Art 76.8
Tints and shades 76.5
Beauty 75.9
Monochrome photography 73.3
Happy 73.3
Rectangle 73
Event 72
Font 71.8
Bride 71.5
Suit 69.9
Monochrome 69.7
Photo caption 68.3

Microsoft
created on 2022-03-05

text 97.5
wedding dress 89.6
black and white 88.6
bride 83.7
clothing 83.6
person 76.1
black 74
woman 64.5
white 60.1
man 60
wedding 59.2

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 63.9%
Calm 55.4%
Happy 43.5%
Angry 0.2%
Fear 0.2%
Disgusted 0.2%
Confused 0.2%
Surprised 0.1%
Sad 0.1%

AWS Rekognition

Age 41-49
Gender Male, 81.7%
Happy 96.7%
Calm 1.8%
Sad 0.5%
Surprised 0.3%
Angry 0.2%
Fear 0.2%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 22-30
Gender Male, 98.7%
Calm 91%
Sad 3.3%
Happy 3%
Angry 1.1%
Disgusted 0.7%
Surprised 0.3%
Confused 0.3%
Fear 0.3%

AWS Rekognition

Age 27-37
Gender Male, 80.3%
Calm 99.7%
Happy 0.1%
Surprised 0%
Confused 0%
Sad 0%
Disgusted 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Shoe 95.7%
Car 95.6%
Wheel 68.4%

Captions

Microsoft

a group of people posing for a photo 77.6%
a group of people standing in front of a building 77.5%
a group of people posing for a picture 77.4%

Text analysis

Amazon

3
o 3 as
as
o
MJI7--YT37A°- -X

Google

MJI7-- YT 37A°2 - - XAGON
YT
-
XAGON
MJI7--
37A°2