Human Generated Data

Title

Untitled (six member family posed standing and sitting in living room with baby on father's lap in center)
Date

1951
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9442

Human Generated Data

Title

Untitled (six member family posed standing and sitting in living room with baby on father's lap in center)

People

Artist: Martin Schweig, American 20th century

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.5
Apparel 99.5
Human 99.1
Person 99.1
Person 98.8
Person 98.5
Person 98.3
Person 97.9
Person 97.4
Interior Design 95.9
Indoors 95.9
Shorts 94.8
Tie 94.4
Accessories 94.4
Accessory 94.4
Furniture 93.9
Chair 93.9
Female 93
Face 91.3
Room 86.8
Dress 81.8
Suit 80.3
Coat 80.3
Overcoat 80.3
Woman 78.5
Floor 78.3
Flooring 78.1
Stage 76.3
People 70.6
Portrait 69.4
Photo 69.4
Photography 69.4
Girl 67.3
Creme 66.1
Dessert 66.1
Cream 66.1
Icing 66.1
Food 66.1
Cake 66.1
Door 65.6
Curtain 63.2
Shirt 57.8
Footwear 57
Shoe 57
Child 55.4
Kid 55.4

Imagga
created on 2022-01-23

man 31.6
person 30.9
adult 29.4
people 28.4
male 26.3
professional 22.2
chair 22.2
teacher 22
happy 21.3
couple 20
smiling 18.1
lifestyle 18.1
kin 17
family 16.9
educator 15.9
wheelchair 15.7
mother 15.3
women 15
smile 15
happiness 14.9
shop 14.6
sitting 14.6
men 13.7
business 13.4
holding 13.2
indoors 13.2
together 13.1
patient 12.9
seat 12.1
businessman 11.5
life 11.5
cheerful 11.4
standing 11.3
senior 11.2
home 11.2
furniture 11
two 11
shopping 11
portrait 11
child 10.8
job 10.6
room 10.6
executive 10.3
youth 10.2
salon 10.2
domestic 10.1
parent 9.9
care 9.9
work 9.8
lady 9.7
husband 9.5
groom 9.5
mature 9.3
shopping cart 9.3
case 9.2
pretty 9.1
attractive 9.1
health 9
active 9
fun 9
interior 8.8
boy 8.7
cute 8.6
father 8.5
clothes 8.4
modern 8.4
joy 8.3
leisure 8.3
teen 8.3
indoor 8.2
children 8.2
dress 8.1
handsome 8
hospital 8
love 7.9
musical instrument 7.9
education 7.8
full length 7.8
corporate 7.7
bride 7.7
old 7.7
wife 7.6
fashion 7.5
meeting 7.5
worker 7.5
sick person 7.4
handcart 7.4
shopper 7.4
hold 7.4
wedding 7.4
20s 7.3
girls 7.3
confident 7.3
group 7.2
office 7.2
daughter 7.2
looking 7.2
holiday 7.2
day 7.1
medical 7.1

Google
created on 2022-01-23

Black-and-white 83.8
Style 83.8
Monochrome photography 72.6
Event 70.9
Monochrome 70.9
Vintage clothing 68.6
Font 66.6
Smile 65.7
Room 63.5
Classic 60.7
Photographic paper 56.7
Happy 55.6
Photo caption 55.1
History 53.4
Curtain 51.7
Sitting 51.6
Chair 50.1

Microsoft
created on 2022-01-23

text 96.9
clothing 90.9
person 88.4
dress 85.8
standing 76.2
woman 72
posing 71.9
wedding dress 68.6

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Calm 77.4%
Surprised 18.1%
Fear 1.8%
Disgusted 1.1%
Angry 0.5%
Sad 0.5%
Confused 0.4%
Happy 0.3%

AWS Rekognition

Age 29-39
Gender Male, 93.9%
Calm 96.9%
Surprised 1.8%
Sad 0.8%
Happy 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 47-53
Gender Female, 72.2%
Happy 78.1%
Calm 10.3%
Surprised 6.7%
Confused 1.5%
Sad 1.3%
Disgusted 1.2%
Angry 0.6%
Fear 0.3%

AWS Rekognition

Age 30-40
Gender Male, 99.7%
Happy 91.7%
Calm 3.2%
Surprised 2.5%
Confused 1.3%
Sad 0.6%
Disgusted 0.4%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.7%
Calm 51.4%
Happy 45.7%
Disgusted 0.9%
Surprised 0.8%
Confused 0.5%
Sad 0.4%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Calm 62.9%
Happy 26.6%
Sad 5.8%
Surprised 1.5%
Angry 1.2%
Confused 0.9%
Disgusted 0.8%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 94.4%
Shoe 57%

Captions

Microsoft

a man and a woman standing in front of a window 43.8%
a person standing in front of a window posing for the camera 43.7%
a person standing in front of a window 43.6%

Text analysis

Amazon

KODOKSVEELA

Google

mm
mm m --- YTRAS
YTRAS
m
---