Human Generated Data

Title

Untitled (woman and young girl posing with doll while boy in toy car watches inside Christmas living room)
Date

1948
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9150

Human Generated Data

Title

Untitled (woman and young girl posing with doll while boy in toy car watches inside Christmas living room)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.2
Person 99.2
Person 94.5
Person 79.7
Workshop 75
People 74.3
Furniture 71.8
Clinic 61.2
Bag 60.9
Backpack 60.9
Apparel 58.9
Clothing 58.9
Transportation 56.3

Imagga
created on 2022-01-23

shop 100
barbershop 100
mercantile establishment 82.4
place of business 54.9
salon 28
establishment 27.4
man 26.9
people 20.1
chair 18.1
male 17.7
adult 17.5
men 17.2
person 15
old 13.9
women 13.4
style 13.3
barber chair 12.2
home 12
working 11.5
indoors 11.4
black 11.4
room 11.1
hair 11.1
window 11
music 10.8
family 10.7
work 10.2
lifestyle 10.1
back 10.1
occupation 10.1
business 9.7
portrait 9.7
office 9.6
youth 9.4
seat 9.3
hairdresser 9.3
city 9.1
vintage 9.1
fashion 9
interior 8.8
job 8.8
scene 8.6
sitting 8.6
smile 8.5
professional 8.5
art 8.5
house 8.3
hand 8.3
happy 8.1
couple 7.8
life 7.8
model 7.8
casual 7.6
two 7.6
care 7.4
retro 7.4
entertainment 7.4
girls 7.3
sexy 7.2

Google
created on 2022-01-23

Black 89.5
Black-and-white 84.8
Style 83.8
Motor vehicle 82.4
Art 81.4
Adaptation 79.4
Tints and shades 76.4
Vintage clothing 75.9
Monochrome 75.1
Monochrome photography 74.3
Snapshot 74.3
Classic 71.1
Room 70
Chair 67.5
Painting 67.4
Event 67.1
Stock photography 65.2
History 65.2
Visual arts 64.8
Photo caption 64.6

Microsoft
created on 2022-01-23

text 98.2
black and white 92.2
clothing 90.9
street 88.9
person 86.9
footwear 60.9
monochrome 56.8
store 31.6
clothes 17.6

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 99.8%
Happy 87.4%
Confused 3.9%
Calm 3.4%
Sad 2.3%
Fear 1.2%
Disgusted 0.8%
Surprised 0.7%
Angry 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Backpack 60.9%

Captions

Microsoft

a group of people sitting in front of a store window 53.8%
a group of people standing in front of a store window 53.7%
a group of people in front of a store window 53.6%

Text analysis

Amazon

8
MJI7

Google

MJ17 YT3RA2 02MA
YT3RA2
MJ17
02MA