Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated with stockings)
Date

1968
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10106

Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated with stockings)

People

Artist: Martin Schweig, American 20th century

Date

1968

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 99.4
Human 99.4
Person 98.9
Person 98.3
Person 97.8
Person 97.7
Person 97.1
Person 96.3
Person 95.9
People 91.9
Person 85.5
Indoors 83
Room 82.2
Living Room 81
Furniture 78.2
Face 71.3
Female 64.4
Crowd 61.1
Girl 59.7
Sideboard 59.4
Curtain 59.2
Photography 58.5
Photo 58.5
Family 56.2

Imagga
created on 2022-01-28

freight car 57.5
car 42.9
wheeled vehicle 34.9
vehicle 23
windowsill 20.9
sill 17.7
blackboard 17.3
television 15.7
silhouette 14.9
architecture 14
art 13.9
building 13.4
people 12.8
structural member 12.6
man 12.1
party 12
black 12
design 11.8
window 11.5
conveyance 11.5
celebration 11.2
old 11.1
structure 10.3
business 10.3
grunge 10.2
vintage 9.9
history 9.8
house 9.2
support 9
style 8.9
night 8.9
urban 8.7
male 8.5
symbol 8.1
group 8.1
person 8
telecommunication system 8
table 7.9
modern 7.7
historical 7.5
pattern 7.5
city 7.5
water 7.3
graphic 7.3
team 7.2

Google
created on 2022-01-28

Rectangle 85.6
Black-and-white 82.6
Font 81.8
Art 81
Picture frame 77.4
Event 73.7
Monochrome photography 73.6
Monochrome 73.2
Curtain 70.4
Visual arts 68.9
Room 67.2
Painting 64.4
History 63.7
Illustration 62.9
Stock photography 62
Photo caption 59.9
Couch 57.4
House 57.1
Vintage clothing 56
Chair 55.3

Microsoft
created on 2022-01-28

text 99.2
person 84.8
wedding dress 65.1
dance 63.6
clothing 63.6
gallery 58.9
room 45.9
picture frame 7.6

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Male, 99.6%
Confused 49.8%
Sad 30.2%
Happy 7.8%
Disgusted 7.2%
Calm 2.6%
Surprised 1.1%
Angry 0.8%
Fear 0.5%

AWS Rekognition

Age 25-35
Gender Male, 99.5%
Sad 59.3%
Calm 29.6%
Confused 6.1%
Happy 1.5%
Disgusted 1.3%
Angry 1.2%
Fear 0.6%
Surprised 0.5%

AWS Rekognition

Age 31-41
Gender Male, 95.9%
Sad 92.3%
Happy 3.2%
Calm 2.5%
Confused 0.6%
Surprised 0.5%
Fear 0.4%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 52-60
Gender Male, 90.5%
Confused 36.3%
Sad 34.7%
Calm 19.1%
Disgusted 7.2%
Surprised 1.2%
Angry 0.7%
Happy 0.5%
Fear 0.3%

AWS Rekognition

Age 19-27
Gender Male, 97.7%
Sad 76.9%
Confused 17.7%
Calm 1.5%
Surprised 1.4%
Disgusted 1.2%
Angry 0.6%
Fear 0.4%
Happy 0.3%

AWS Rekognition

Age 36-44
Gender Female, 64.5%
Sad 65.9%
Disgusted 14.6%
Calm 8.2%
Angry 3.9%
Confused 2.5%
Happy 2.1%
Surprised 1.6%
Fear 1.2%

AWS Rekognition

Age 23-33
Gender Male, 98.9%
Calm 53.8%
Sad 45.3%
Angry 0.2%
Confused 0.2%
Fear 0.2%
Disgusted 0.2%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 40-48
Gender Male, 99.4%
Disgusted 46.7%
Happy 26%
Sad 9%
Angry 4.2%
Calm 3.9%
Fear 3.7%
Confused 3.5%
Surprised 3.1%

AWS Rekognition

Age 51-59
Gender Female, 98.7%
Happy 88.1%
Calm 4%
Sad 2.6%
Disgusted 1.7%
Fear 1.6%
Surprised 0.8%
Angry 0.7%
Confused 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people in a room 75.5%
a screen shot of a group of people in a room 72.4%
a group of people standing in a room 65.9%

Text analysis

Amazon

5
KODAK
FILM
9
JULiE
KODAK SAFETY
SAFETY
DAVID

Google

S'AFETY
KODAK S'AFETY FILM KODAK S'AFETY FILM
KODAK
FILM