Human Generated Data

Title

Untitled (man smiling at woman off camera while sitting with drink on couch)
Date

1955
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9895

Human Generated Data

Title

Untitled (man smiling at woman off camera while sitting with drink on couch)

People

Artist: Martin Schweig, American 20th century

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Furniture 100
Chair 100
Table 96.4
Couch 95.8
Human 94.8
Person 94.8
Home Decor 94.8
Tabletop 92.8
Dining Table 90.8
Bed 89
Cushion 88.5
Pillow 86.5
Indoors 85.2
Face 84.5
Room 80.8
Living Room 77
Portrait 66.9
Photography 66.9
Photo 66.9
Clothing 66.4
Apparel 66.4
Meal 62.7
Food 62.7
Dish 62.7
Female 59.9
Sitting 59.1
Tablecloth 58.9
Art 57.3
Girl 55.9

Imagga
created on 2022-01-28

newspaper 53
product 42
creation 31.7
man 29.6
person 28.8
male 23
people 22.3
sitting 21.5
outdoors 21.2
adult 20.3
smiling 20.2
home 19.9
laptop 19.3
happy 18.8
lifestyle 17.3
computer 16.9
senior 16.9
scholar 16.8
attractive 16.8
mother 16.4
together 15.8
casual 15.2
couple 14.8
portrait 14.2
intellectual 13.4
elderly 13.4
working 13.3
mature 13
technology 12.6
child 12.5
handsome 12.5
leisure 12.4
cheerful 12.2
looking 12
love 11.8
day 11.8
retired 11.6
seller 11.6
family 11.6
business 11.5
retirement 11.5
boy 11.3
men 11.2
beach 11.1
room 11
happiness 11
relaxing 10.9
park 10.7
professional 10.7
indoors 10.5
reading 10.5
grandma 10.5
old 10.4
notebook 10.4
relaxation 10
teenager 10
house 10
smile 10
holding 9.9
work 9.8
kid 9.7
women 9.5
clothing 9.1
alone 9.1
fun 9
businessman 8.8
using 8.7
outside 8.6
life 8.5
tree 8.5
relax 8.4
pretty 8.4
summer 8.4
glasses 8.3
teen 8.3
chair 8.2
aged 8.1
holiday 7.9
grandmother 7.8
sea 7.8
father 7.8
typing 7.8
education 7.8
older 7.8
outdoor 7.6
enjoying 7.6
communication 7.6
enjoyment 7.5
human 7.5
one 7.5
office 7.2
sunset 7.2

Google
created on 2022-01-28

Black-and-white 86.4
Style 84
Adaptation 79.4
Art 77.5
Monochrome photography 76.8
Monochrome 76.3
Font 75.5
Chair 74.8
Couch 70.6
Room 70
Pattern 68.3
Visual arts 66.4
T-shirt 64.5
Sitting 63.8
Recreation 61.3
History 59.7
Photographic paper 59.2
Vintage clothing 58.9
Table 57.5
Indoor games and sports 56.7

Microsoft
created on 2022-01-28

text 97.7
furniture 94
person 93.9
table 90.2
window 84.9
bed 78.2
couch 71.5
vase 64.4
chair 57.1

Face analysis

Google

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.8%
Bed 89%

Captions

Microsoft

a little girl sitting in front of a window 51.8%
a girl sitting in front of a window 51.7%

Text analysis

Amazon

h-0