Human Generated Data

Title

Untitled (man and woman in day clothes descending small staircase in fancy building)
Date

1948-1950
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9293

Human Generated Data

Title

Untitled (man and woman in day clothes descending small staircase in fancy building)

People

Artist: Martin Schweig, American 20th century

Date

1948-1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 96.3
Apparel 96.3
Person 96.1
Human 96.1
Person 94.9
Person 94.5
Person 94.2
Person 91.8
Handrail 81.5
Banister 81.5
Overcoat 76.3
Coat 76.3
Suit 70.1
Tie 64.6
Accessories 64.6
Accessory 64.6
Staircase 60.6
Sleeve 55.3

Imagga
created on 2022-01-23

business 35.8
male 33.3
businessman 32.7
man 32.2
office 32.2
people 30.7
corporate 29.2
adult 26.5
person 25
suit 22.3
professional 21.7
musical instrument 19.6
executive 19.3
building 19
men 18.9
wind instrument 18.1
meeting 17
happy 16.9
businesswoman 16.4
room 16.3
group 16.1
indoor 15.5
looking 15.2
job 15
women 15
brass 15
indoors 14.9
work 14.1
modern 14
life 13.8
handsome 13.4
businesspeople 13.3
desk 13.2
worker 12.7
attractive 12.6
team 12.5
manager 12.1
mature 12.1
success 12.1
black 11.5
smile 11.4
career 11.4
standing 11.3
education 11.3
pretty 11.2
sitting 11.2
laptop 11
portrait 11
classroom 11
confident 10.9
couple 10.5
teamwork 10.2
day 10.2
casual 10.2
two 10.2
communication 10.1
successful 10.1
employee 9.9
outfit 9.8
fashion 9.8
colleagues 9.7
boss 9.6
table 9.5
tie 9.5
sax 9.3
teacher 9.2
occupation 9.2
holding 9.1
cheerful 8.9
computer 8.9
40s 8.8
hall 8.7
smiling 8.7
corporation 8.7
diversity 8.6
chair 8.6
happiness 8.6
adults 8.5
senior 8.4
company 8.4
device 8.2
architecture 8.1
interior 8
lifestyle 7.9
urban 7.9
businessperson 7.8
speaker 7.8
confidence 7.7
formal 7.6
finance 7.6
thinking 7.6
inside 7.4
student 7.3
alone 7.3
color 7.2
face 7.1
working 7.1
travel 7
together 7

Google
created on 2022-01-23

Standing 86.4
Black-and-white 85.8
Style 83.9
Monochrome 78.6
Art 77.6
Monochrome photography 75.6
Machine 68.6
Rectangle 68.6
Room 67.1
Stairs 66.8
Symmetry 65.3
Stock photography 63.6
Illustration 63.1
Street fashion 61.1
Visual arts 60.9
Vintage clothing 53.8
Painting 52.9
Photographic paper 52.2
Handrail 51.4
Street 50.8

Microsoft
created on 2022-01-23

man 94.6
clothing 93.8
black and white 92.6
person 91.1
text 80.2
monochrome 58.8

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 84.2%
Surprised 13.5%
Happy 0.8%
Sad 0.5%
Confused 0.4%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 95.1%
Calm 60.6%
Sad 11.5%
Disgusted 7.5%
Happy 7.1%
Surprised 6.9%
Confused 4.2%
Angry 1.2%
Fear 0.9%

AWS Rekognition

Age 25-35
Gender Female, 93.1%
Calm 52%
Sad 24.8%
Fear 10.9%
Confused 7.4%
Happy 1.8%
Angry 1.7%
Disgusted 0.8%
Surprised 0.6%

AWS Rekognition

Age 40-48
Gender Male, 96%
Fear 98.2%
Sad 0.6%
Disgusted 0.5%
Calm 0.3%
Angry 0.2%
Happy 0.1%
Confused 0.1%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.1%
Suit 70.1%
Tie 64.6%

Captions

Microsoft

a man standing in front of a door 81.6%
a man standing next to a door 76.5%
a man standing in a room 76.4%

Text analysis

Amazon

MANDARIN
ROOM
WALNUT
FIRST
WALNUT ROOM
FIRST FLOOR
VERSAILLES ROOM
TAP
TAP ROOM
FLOOR
VERSAILLES
MARINE
PULL
MANDARIN ROOM 1
1

Google

MARINE ROOM ROOM
MARINE
ROOM