Human Generated Data

Title

Untitled (family outside of house in snow)

Date

1965

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16772

Human Generated Data

Title

Untitled (family outside of house in snow)

People

Artist: Lucian and Mary Brown, American

Date

1965

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16772

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.4
Human 99.4
Person 99.2
Person 99
Person 98.1
Clothing 93.4
Apparel 93.4
Person 88.9
Nature 87.4
Outdoors 84
Person 83.9
Home Decor 73.4
Suit 68.4
Overcoat 68.4
Coat 68.4
People 65.5
Path 63.1
Pedestrian 60.7
Face 57.6

Clarifai
created on 2023-10-29

people 99.9
monochrome 98.6
street 98.6
group together 97.1
adult 97.1
man 95.8
group 94.4
woman 92.2
many 90.3
child 90.3
two 88.6
home 81.8
beach 81.2
one 80.7
recreation 80
print 79.5
town 78.8
art 77.8
wear 77.6
family 77.5

Imagga
created on 2022-02-26

garage 33.3
building 29.3
structure 28.2
house 27.7
architecture 26.5
sky 22.3
roof 17.7
old 17.4
construction 15.4
home 15.2
landscape 13.4
school 12.9
window 12.6
wood 12.5
travel 12
rural 11.5
farm 10.7
residential 10.5
new 10.5
summer 10.3
city 10
trees 9.8
wooden 9.7
lawn 9.4
door 9.4
tree 9.2
outdoors 9.2
patio 9.2
tourism 9.1
village 9.1
religion 9
history 8.9
residence 8.9
center 8.8
country 8.8
ancient 8.6
garden 8.6
estate 8.5
clouds 8.5
traditional 8.3
temple 8
urban 7.9
culture 7.7
barn 7.6
real 7.6
park 7.5
exterior 7.4
sun 7.2
scenic 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 98.8
outdoor 91.7
black and white 90.7
person 84.4
clothing 60.1
street 59.9
monochrome 54.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Male, 98.5%
Confused 60.7%
Sad 23.2%
Calm 10.2%
Happy 2.1%
Disgusted 1.3%
Angry 1.2%
Surprised 0.9%
Fear 0.3%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Sad 49.3%
Calm 43.1%
Happy 2.2%
Confused 1.7%
Disgusted 1.4%
Angry 0.9%
Fear 0.8%
Surprised 0.7%

AWS Rekognition

Age 28-38
Gender Female, 99.5%
Calm 55.4%
Sad 22.9%
Disgusted 11.3%
Happy 5%
Surprised 2.4%
Confused 1.4%
Angry 1%
Fear 0.6%

AWS Rekognition

Age 26-36
Gender Female, 80%
Calm 83.6%
Sad 6.5%
Happy 6.4%
Confused 1.3%
Disgusted 0.7%
Fear 0.6%
Surprised 0.5%
Angry 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.4%
Person 99.2%
Person 99%
Person 98.1%
Person 88.9%
Person 83.9%

Categories

Text analysis

Amazon

4
8
KODK--EEA-i

Google

MJ17- -YT3R2--XAO
MJ17-
-YT3R2--XAO