Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated with stockings)

Date

1968

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10107

Human Generated Data

Title

Untitled (nine children posed sitting in front of fireplace decorated with stockings)

People

Artist: Martin Schweig, American 20th century

Date

1968

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Human 99.4
Person 99.4
Person 98.6
Person 98.6
Person 98.1
Person 95.3
Person 92.4
Indoors 91.8
Room 91.8
Living Room 91.6
Person 90.4
Person 89.7
People 89.5
Interior Design 81.3
Person 79.6
Furniture 77.3
Face 74.5
Female 72.3
Clothing 65
Apparel 65
Girl 62.3
Curtain 61.6
Sideboard 59.1
Cabinet 58.9
Family 55.4

Imagga
created on 2022-01-28

windowsill 22.4
blackboard 20.3
sill 18.9
television 18.6
room 17.1
building 15.1
architecture 14
classroom 13.6
structural member 13.5
freight car 13.4
structure 13.4
window 13.4
old 12.5
monitor 12.1
home 11.9
design 11.8
people 11.7
office 11.6
business 11.5
black 11.4
art 11.3
history 10.7
screen 10.7
cinema 10.6
man 10.1
house 10
car 10
theater 9.9
telecommunication system 9.9
vintage 9.9
tourism 9.9
computer 9.9
support 9.7
table 9.6
antique 9.5
grunge 9.4
decoration 9
pattern 8.9
interior 8.8
historical 8.5
wheeled vehicle 8.4
altar 8.4
silhouette 8.3
paint 8.1
digital 8.1
travel 7.7
sitting 7.7
modern 7.7
frame 7.5
church 7.4
water 7.3
indoor 7.3
life 7.3
celebration 7.2
team 7.2
sculpture 7.1
women 7.1
male 7.1

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

text 97.8
black and white 74.2
house 72.8
drawing 70.6
gallery 60.1
picture frame 7.2

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Confused 61.3%
Sad 17.7%
Calm 8%
Happy 7.3%
Disgusted 1.9%
Surprised 1.9%
Fear 1.2%
Angry 0.6%

AWS Rekognition

Age 35-43
Gender Male, 98.2%
Calm 50.2%
Sad 47.1%
Angry 0.5%
Surprised 0.5%
Fear 0.5%
Confused 0.4%
Happy 0.4%
Disgusted 0.4%

AWS Rekognition

Age 51-59
Gender Female, 98.3%
Sad 77.6%
Calm 8.9%
Surprised 3.7%
Happy 2.6%
Angry 2.4%
Confused 2.2%
Disgusted 2%
Fear 0.7%

AWS Rekognition

Age 48-54
Gender Male, 99.4%
Sad 99%
Calm 0.6%
Confused 0.1%
Fear 0.1%
Angry 0.1%
Happy 0.1%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 34-42
Gender Female, 59.6%
Sad 66.6%
Surprised 11.3%
Happy 10%
Calm 6%
Angry 2.6%
Fear 1.7%
Confused 1.3%
Disgusted 0.5%

AWS Rekognition

Age 30-40
Gender Male, 99.3%
Happy 52.7%
Sad 25.4%
Calm 11.5%
Confused 2.6%
Fear 2.5%
Surprised 2.1%
Disgusted 1.6%
Angry 1.6%

AWS Rekognition

Age 29-39
Gender Male, 98.6%
Sad 89.4%
Calm 8.9%
Confused 0.7%
Fear 0.4%
Disgusted 0.2%
Happy 0.2%
Surprised 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people in a room 83.6%
a group of people standing in a room 76.2%
a group of people posing for a photo 59.5%

Text analysis

Amazon

8
KODAK
FILM
KODAK SAFETY
JULiE
Better
SAFETY
ave

Google

FILM
JULIE S'AFETY FILM KODAK SAFETY FILM KODAK
S'AFETY
KODAK
JULIE
SAFETY