Human Generated Data

Title

[Julia Feininger, Hermann Klumpp, an unidentified woman, and Andreas Feininger looking at watercolors]

Date

unknown

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.152.22

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Julia Feininger, Hermann Klumpp, an unidentified woman, and Andreas Feininger looking at watercolors]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

unknown

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-04

Apparel 99.9
Clothing 99.9
Human 98.9
Person 98.9
Bird 97.9
Animal 97.9
Sunglasses 91.9
Accessories 91.9
Accessory 91.9
Robe 86.1
Fashion 86.1
Gown 84.5
Face 75.8
Wedding 74.8
Bird 66.8
Wedding Gown 66.4
Female 66.3
Photography 66.2
Portrait 66.2
Photo 66.2
Suit 66.1
Coat 66.1
Overcoat 66.1
Person 65.8
Bird 62.2
Dog 62.1
Mammal 62.1
Canine 62.1
Pet 62.1
Cat 61.1
Text 60.3
Art 59.9
Bride 55.8
Person 55.3

Clarifai
created on 2021-04-04

people 99.9
adult 98.9
group 98.7
monochrome 96.3
man 95.5
wear 95.3
two 95.1
administration 93.2
portrait 93.1
leader 92.2
woman 92
music 88.4
three 87.7
medical practitioner 87.6
group together 86.6
facial expression 86.3
several 85.9
chair 83.5
furniture 83
one 82

Imagga
created on 2021-04-04

office 55.1
laptop 50.4
computer 50
business 42.5
working 39.8
professional 38.9
people 38
man 37.7
businesswoman 37.3
person 34.9
adult 33
work 33
businessman 32.7
desk 31.4
corporate 30.9
sitting 30.9
worker 30.7
male 30.5
job 29.2
businesspeople 26.6
happy 25.1
smiling 24.6
negative 24
meeting 23.6
table 23.5
executive 23.1
indoors 22
portrait 21.4
confident 20.9
looking 20.8
technology 20
team 19.7
notebook 19.3
success 19.3
film 19.3
group 18.5
smile 18.5
successful 18.3
teamwork 17.6
indoor 16.4
attractive 16.1
keyboard 16
communication 16
manager 15.8
education 15.6
occupation 15.6
suit 15.6
modern 15.4
photographic paper 14.9
monitor 14.6
cheerful 14.6
casual 14.4
colleagues 13.6
face 13.5
workplace 13.3
mature 13
horizontal 12.6
room 12.4
career 12.3
color 12.2
groom 12.2
home 12
one 12
specialist 11.8
handsome 11.6
lifestyle 11.6
formal 11.5
serious 11.4
employee 11.3
pretty 11.2
women 11.1
two 11
classroom 10.9
holding 10.7
partners 10.7
using 10.6
wireless 10.5
talking 10.5
screen 10.4
smart 10.4
senior 10.3
newspaper 10
photographic equipment 9.9
30s 9.6
secretary 9.6
jacket 9.5
teacher 9.5
sit 9.5
men 9.5
expression 9.4
student 9.4
coat 9.3
presentation 9.3
company 9.3
20s 9.2
consultant 8.8
partner 8.7
mid adult 8.7
busy 8.7
collar 8.6
happiness 8.6
bright 8.6
ethnic 8.6
lab coat 8.5
pen 8.5
finance 8.5
glasses 8.3
training 8.3
patient 8.2
coworkers 7.9
paper 7.8
book 7.8
project 7.7
old 7.7
boss 7.7
clinic 7.6
tie 7.6
product 7.6
college 7.6
contemporary 7.5
study 7.5
document 7.4
phone 7.4
alone 7.3
creation 7.3
school 7.2
day 7.1
medical 7.1

Google
created on 2021-04-04

Microsoft
created on 2021-04-04

drawing 96.5
sketch 93.5
text 92.4
black and white 90.2
wedding dress 79.9
clothing 79.2
person 77.5
painting 71
human face 64.8
woman 60.5

Face analysis

Amazon

Google

AWS Rekognition

Age 48-66
Gender Male, 97.9%
Calm 67.5%
Surprised 17.4%
Confused 9.1%
Angry 2.3%
Disgusted 1.8%
Fear 0.8%
Happy 0.7%
Sad 0.5%

AWS Rekognition

Age 51-69
Gender Male, 84.1%
Sad 94.3%
Calm 4.5%
Confused 0.8%
Fear 0.1%
Happy 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0%

AWS Rekognition

Age 32-48
Gender Male, 59.3%
Angry 56.5%
Calm 41.9%
Sad 0.7%
Disgusted 0.3%
Confused 0.2%
Happy 0.2%
Surprised 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Bird 97.9%
Sunglasses 91.9%
Dog 62.1%
Cat 61.1%

Captions

Microsoft

a group of people standing in front of a window 81.4%
a group of people standing in front of a bird 72.9%
a group of people standing next to a window 72.8%