Human Generated Data

Title

Untitled (young girl sitting next to doll in rocking chair by fireplace)
Date

1960
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9751

Human Generated Data

Title

Untitled (young girl sitting next to doll in rocking chair by fireplace)

People

Artist: Martin Schweig, American 20th century

Date

1960

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Furniture 97.8
Person 97.6
Human 97.6
Chair 96.5
Person 92.9
Table 66.7
Apparel 65.1
Clothing 65.1
Baby 64.7
Indoors 63.3
Room 63.3
Bed 60.3
Art 58.4
Drawing 58.4

Imagga
created on 2022-01-24

barbershop 100
shop 90.4
mercantile establishment 67.9
place of business 45.3
chair 41.7
barber chair 32.1
man 29.6
people 26.2
room 25.1
indoors 24.6
office 24.5
seat 22.8
establishment 22.6
male 22
interior 20.3
furniture 20.1
home 19.9
hairdresser 19.6
work 18.8
adult 18.2
business 17
working 16.8
hospital 16.7
person 16.7
salon 15.9
men 15.5
modern 15.4
computer 15.2
worker 13.5
desk 13.4
medical 13.2
table 13.1
professional 12.9
occupation 12.8
patient 12.6
businessman 12.4
equipment 12.3
doctor 12.2
sitting 12
technology 11.9
women 11.9
health 11.8
communication 11.8
lifestyle 11.6
medicine 10.6
clinic 10.4
meeting 10.4
senior 10.3
indoor 10
happy 10
job 9.7
illness 9.5
talking 9.5
smiling 9.4
architecture 9.4
window 9.2
old 9.1
team 9
building 8.8
surgery 8.8
two 8.5
portrait 8.4
horizontal 8.4
house 8.4
teamwork 8.3
inside 8.3
holding 8.3
laptop 8.2
businesswoman 8.2
family 8
urban 7.9
corporate 7.7
monitor 7.7
city 7.5
restaurant 7.4
phone 7.4
light 7.4
back 7.3
nurse 7.2
success 7.2
kitchen 7.2
smile 7.1
to 7.1
life 7
together 7

Google
created on 2022-01-24

Black 89.6
Black-and-white 81.9
Art 81.6
Tints and shades 76.1
Monochrome photography 73.6
Monochrome 71.3
Rectangle 68
Stock photography 66.2
Visual arts 64.6
Room 64.1
Sitting 60.3
Vintage clothing 58.6
Photographic paper 56.3
Font 53.5

Microsoft
created on 2022-01-24

text 98.6
drawing 88.6
black and white 88.1
clothing 88
person 85.9

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 29.8%
Surprised 28.8%
Happy 14.5%
Confused 12%
Disgusted 5.6%
Sad 3.4%
Fear 3%
Angry 2.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%

Captions

Microsoft

a group of people in a room 58.3%
a group of people sitting in a room 43.2%

Text analysis

Amazon

your
SECURITY

Google

T37A°2
XAGO
MJI7--
--
MJI7-- Y T37A°2 -- XAGO
Y