Human Generated Data

Title

Untitled (nine children posed eating giant lollipops in living room)

Date

1953

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9467

Human Generated Data

Title

Untitled (nine children posed eating giant lollipops in living room)

People

Artist: Martin Schweig, American 20th century

Date

1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.8
Human 99.8
Person 99.7
Person 99.7
Person 99.5
Person 99.2
Person 99.2
Person 99.1
Apparel 98.1
Clothing 98.1
Person 92.8
Leisure Activities 87.3
Chair 82.8
Furniture 82.8
Musical Instrument 80.5
Musician 80.5
Plaid 79.5
Tartan 79.5
Music Band 68
Skirt 66.9
Shoe 66.2
Footwear 66.2
Indoors 63.9
Interior Design 63.6
Bagpipe 57.2
Shop 56
Kilt 55.8
Room 55.4
Shoe 55.2

Imagga
created on 2022-01-23

brass 51.2
wind instrument 45.9
musical instrument 35.1
man 27.5
people 27.3
trombone 25.3
cornet 22.6
business 22.4
male 22
businessman 21.2
men 17.1
person 16.8
adult 16.1
group 13.7
musician 12.8
couple 12.2
women 11.8
singer 11.7
black 11.5
dress 10.8
performer 10.7
office 10.6
bride 10.5
corporate 10.3
wedding 10.1
city 10
success 9.6
groom 9.4
hand 9.1
silhouette 9.1
human 9
oboe 9
handsome 8.9
together 8.7
urban 8.7
stage 8.7
crowd 8.6
modern 8.4
leisure 8.3
fashion 8.3
music 8.2
art 8.2
happy 8.1
suit 8.1
love 7.9
clothing 7.9
scene 7.8
travel 7.7
sport 7.7
room 7.6
active 7.5
holding 7.4
style 7.4
guitar 7.4
executive 7.4
new 7.3
businesswoman 7.3
worker 7.2
looking 7.2
transportation 7.2
family 7.1
happiness 7
indoors 7

Google
created on 2022-01-23

Photograph 94.2
Dress 84.2
Style 83.8
Hat 83.1
Line 81.6
Motor vehicle 77
Vehicle 77
Vintage clothing 75.5
Snapshot 74.3
Monochrome 72.7
Room 71.9
Event 71.8
Classic 69.8
Monochrome photography 66
Font 65.7
Art 65
History 64.9
Team 64.5
Advertising 63.9
Stock photography 63.7

Microsoft
created on 2022-01-23

text 97.1
clothing 93.7
person 93.6
dress 79.7
woman 62.1
black and white 59.2
dance 56.8

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Female, 76.6%
Calm 96%
Sad 2.5%
Surprised 1.1%
Disgusted 0.2%
Happy 0.1%
Confused 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 47-53
Gender Male, 98.4%
Sad 96.8%
Confused 0.9%
Calm 0.8%
Angry 0.6%
Happy 0.3%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Male, 97.3%
Surprised 40.4%
Confused 24.2%
Calm 13.5%
Sad 7%
Disgusted 6.8%
Happy 4.9%
Angry 2.5%
Fear 0.8%

AWS Rekognition

Age 30-40
Gender Male, 92.7%
Surprised 82.2%
Calm 6.8%
Confused 4.4%
Sad 3.9%
Disgusted 1.6%
Angry 0.4%
Happy 0.4%
Fear 0.3%

AWS Rekognition

Age 28-38
Gender Male, 100%
Sad 71.8%
Surprised 24.5%
Calm 1.2%
Fear 0.7%
Disgusted 0.6%
Happy 0.5%
Confused 0.4%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Chair 82.8%
Shoe 66.2%

Captions

Microsoft

a group of people posing for a photo 83.7%
a group of people posing for the camera 83.6%
a group of people standing in front of a building 83.5%

Text analysis

Amazon

11351
451

Google

T3 ऽ ।।
।।
T3